Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
We design a series of online performance feedback interventions that aim to motivate the production of user-generated content (UGC). Drawing on social value orientation (SVO) theory, we develop a novel set of alternative feedback message framings, aligned with cooperation (e.g., your content benefited others), individualism (e.g., your content was of high quality), and competition (e.g., your content was better than others). We hypothesize how gender (a proxy for SVO) moderates response to each framing, and we report on two randomized experiments, one in partnership with a mobile-app–based recipe crowdsourcing platform, and a follow-up experiment on Amazon Mechanical Turk involving an ideation task. We find evidence that cooperatively framed feedback is most effective for motivating female subjects, whereas competitively framed feedback is most effective at motivating male subjects. Our work contributes to the literatures on performance feedback and UGC production by introducing cooperative performance feedback as a theoretically motivated, novel intervention that speaks directly to users’ altruistic intent in a variety of task settings. Our work also contributes to the message-framing literature in considering competition as a novel addition to the altruism–egoism dichotomy oft explored in public good settings. The online appendix is available at https://doi.org/10.1287/mnsc.2017.2944 . This paper was accepted by Chris Forman, information systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions
Oliver, R. L. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700405 · Cited by 14,494
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 1×
“More than 100 years of research has explored the use of performance feedback interventions to motivate learning and e ff ort in work and educational settings (e.g., Kluger and DeNisi 1996, Hattie and Timperley 2007, Jung et al. 2010).”
BackgroundHow Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
The Pure Theory of Public Expenditure
Samuelson, P. A. (1954) · The Review of Economics and Statistics · doi:10.2307/1925895 · Cited by 7,458
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Gender Differences in Preferences
Croson, R., & Gneezy, U. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.2.448 · Cited by 5,694
The self and social behavior in differing cultural contexts.
Triandis, H. C. (1989) · Psychological Review · doi:10.1037/0033-295x.96.3.506 · Cited by 5,019 · cited 1×
“The Chinese context of the main field experiment may also pose a generalizability concern, as numerous prior studies speak to cultural di ff erences in social behavior (e.g., Triandis 1989, 1994).”
Baron-Cohen, S., & Wheelwright, S. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000022607.19833.00 · Cited by 4,093
Do Women Shy Away From Competition? Do Men Compete Too Much?
Niederle, M., & Vesterlund, L. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1067 · Cited by 3,186
Performance in competitive environments: gender differences
Gneezy, U., Niederle, M., & Rustichini, A. (2003) · The Quarterly Journal of Economics · doi:10.1162/00335530360698496 · Cited by 1,997 · cited 2×
“It has therefore been found that competition increases the performance of men, but not of women (Gneezy et al. 2003, Morin 2015, Shurchkov 2012).”
Which is the fair sex? Gender differences in altruism.
Andreoni, J., & Vesterlund, L. (2001) · The Quarterly Journal of Economics · doi:10.1162/003355301556419 · Cited by 1,427
Van Lange, P. A. M., De Bruin, E. M. N., Otten, W., & Joireman, J. A. (1997) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.73.4.733 · Cited by 1,209
Van Lange, P. A. M. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.2.337 · Cited by 1,127
Roberts, J. A., Hann, I.-H., & Slaughter, S. A. (2006) · Management Science · doi:10.1287/mnsc.1060.0554 · Cited by 1,024
Social Influence Bias: A Randomized Experiment
Muchnik, L., Aral, S., & Taylor, S. J. (2013) · Science · doi:10.1126/science.1240466 · Cited by 892 · cited 1×
“…these characteristics, including the contributor’s popularity (Goes et al. 2014) and cultural background (Hong et al. 2016), the activity of a contributor’s social network neighbors (Zeng and Wei 2013), and the timing and sequence of UGC contributions (Godes and Silva 2012, Muchnik et al. 2013).”
Do Women Shy Away From Competition? Do Men Compete Too Much?
Niederle, M., & Vesterlund, L. (2005) · doi:10.3386/w11474 · Cited by 713
Swann, W. B. (2012) · Handbook of Theories of Social Psychology · doi:10.4135/9781446249222.n27 · Cited by 553
Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia
Zhang, X. (., & Zhu, F. (2011) · American Economic Review · doi:10.1257/aer.101.4.1601 · Cited by 499 · cited 5×
“…foster sustained participation (Trusov et al. 2010, Zhang et al. 2013), identifying a series of motivational factors, ranging from audience size (Zhang and Zhu 2011), social capital (Kankanhalli et al. 2005, Ma and Agarwal 2007, Wasko and Faraj 2005), and network position (Zhang and Wang 2012),…”
BackgroundInfluentialContent or Community? A Digital Business Strategy for Content Providers in the Social Age1
Oestreicher-Singer, G., & Zalmanson, L. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.2.12 · Cited by 422 · cited 1×
“Other recent work has explored the e ff ects of “calls to action” and the importance of starting small and then gradually building those calls toward more e ff ort-intensive contributions (Oestreicher-Singer and Zalmanson 2013).”
The 1% rule in four digital health social networks: An observational study
van Mierlo, T. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2966 · Cited by 339 · cited 1×
“It has even been reported that a mere 1% of the people who consume UGC also actively contribute it—known as the “1% rule” (van Mierlo 2014).”
Two Formulas for Success in Social Media: Learning and Network Effects
Qiu, L., Tang, Q., & Whinston, A. B. (2015) · Journal of Management Information Systems · doi:10.1080/07421222.2015.1138368 · Cited by 92
Cited by
The impact of social nudges on user-generated content for social network platforms
Zeng, Z., Dai, H., Zhang, D. J., Zhang, H., Zhang, R., Xu, Z., & Shen, Z.-J. M. (2023) · Management Science · doi:10.1287/mnsc.2022.4622 · Cited by 76
Lin, F., Tian, H., Zhao, J., & Chi, M. (2023) · Internet Research · doi:10.1108/intr-05-2021-0292 · Cited by 22
Metadata
- Authors
- Huang, N., Burtch, G., Gu, B., Hong, Y., Liang, C., Wang, K., Fu, D., & Yang, B.
- Venue
- Management Science
- Published
- 2019-01
- Volume
- 65
- Issue
- 1
- Pages
- 327-345
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2620014249
- Cited by
- 173
- References
- 21
- FWCI
- 19.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.