Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments
Open accessThe DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Abstract
We design a series of online performance feedback interventions that aim to motivate the production of user-generated content (UGC). Drawing on social value orientation (SVO) theory, we develop a novel set of alternative feedback message framings, aligned with cooperation (e.g., your content benefited others), individualism (e.g., your content was of high quality), and competition (e.g., your content was better than others). We hypothesize how gender (a proxy for SVO) moderates response to each framing, and we report on two randomized experiments, one in partnership with a mobile-app–based recipe crowdsourcing platform, and a follow-up experiment on Amazon Mechanical Turk involving an ideation task. We find evidence that cooperatively framed feedback is most effective for motivating female subjects, whereas competitively framed feedback is most effective at motivating male subjects. Our work contributes to the literatures on performance feedback and UGC production by introducing cooperative performance feedback as a theoretically motivated, novel intervention that speaks directly to users’ altruistic intent in a variety of task settings. Our work also contributes to the message-framing literature in considering competition as a novel addition to the altruism–egoism dichotomy oft explored in public good settings. The online appendix is available at https://doi.org/10.1287/mnsc.2017.2944 . This paper was accepted by Chris Forman, information systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions
Oliver, R. L. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700405 · Cited by 14,494 · cited 1×
“Our aggregate results in column (1) of Table 5 appear to align, broadly, with expectation confirmation theory (Oliver 1980).”
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 1×
“More than 100 years of research has explored the use of performance feedback interventions to motivate learning and e ff ort in work and educational settings (e.g., Kluger and DeNisi 1996, Hattie and Timperley 2007, Jung et al. 2010).”
BackgroundHow Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641 · cited 2×
“We also explored the robustness of our estimates to alternative model specifications given the serially correlated outcomes (Bertrand et al. 2004).”
The Pure Theory of Public Expenditure
Samuelson, P. A. (1954) · The Review of Economics and Statistics · doi:10.2307/1925895 · Cited by 7,458 · cited 1×
“…its value, UGC often su ff ers from an underprovisioning problem (Burtch et al. 2017, Chen et al. 2010, Kraut et al. 2012), in large part because it is a public good (Samuelson 1954); UGC is typically supplied on a voluntary basis, and its value is di ffi cult for the contributor to internalize.”
BackgroundKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · cited 2×
“Despite the broad assumption in much of the literature that performance feedback interventions are beneficial, later reviews of the lengthy literature document that the impacts have been decid-edly mixed with more than one-third of studies reporting negative outcomes (Kluger and DeNisi 1996).”
Gender Differences in Preferences
Croson, R., & Gneezy, U. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.2.448 · Cited by 5,694 · cited 2×
“Studies suggest that males respond more positively to competition than females (Croson and Gneezy 2009, Gneezy et al. 2003, Niederle and Vesterlund 2007), a result that can be explained, at least in part, by the fact that men are more likely to be overconfident (Beyer 1990, De Paola et al. 2014) and…”
BackgroundResultThe self and social behavior in differing cultural contexts.
Triandis, H. C. (1989) · Psychological Review · doi:10.1037/0033-295x.96.3.506 · Cited by 5,019 · cited 1×
“The Chinese context of the main field experiment may also pose a generalizability concern, as numerous prior studies speak to cultural di ff erences in social behavior (e.g., Triandis 1989, 1994).”
Baron-Cohen, S., & Wheelwright, S. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000022607.19833.00 · Cited by 4,093 · cited 1×
“The latter observation, that women tend to feel more empathy, has also been confirmed in a variety of other studies in social psychology (Baron-Cohen and Wheelwright 2004, Eisenberg and Lennon 1983).”
Wasko, M. M., & Faraj, S. (2005) · MIS Quarterly · doi:10.2307/25148667 · Cited by 3,904 · cited 2×
“…a series of motivational factors, ranging from audience size (Zhang and Zhu 2011), social capital (Kankanhalli et al. 2005, Ma and Agarwal 2007, Wasko and Faraj 2005), and network position (Zhang and Wang 2012), to civil voluntarism (Phang et al. 2015) and community commitment (Bateman et al.…”
(2007) · Wiley eBooks · doi:10.1002/9780470147658 · Cited by 3,845
Cited by
The impact of social nudges on user-generated content for social network platforms
Zeng, Z., Dai, H., Zhang, D. J., Zhang, H., Zhang, R., Xu, Z., & Shen, Z.-J. M. (2023) · Management Science · doi:10.1287/mnsc.2022.4622 · Cited by 76
Lin, F., Tian, H., Zhao, J., & Chi, M. (2023) · Internet Research · doi:10.1108/intr-05-2021-0292 · Cited by 22
Metadata
- Authors
- Huang, N., Burtch, G., Gu, B., Hong, Y., Liang, C., Wang, K., Fu, D., & Yang, B.
- Venue
- Management Science
- Published
- 2019-01
- Volume
- 65
- Issue
- 1
- Pages
- 327-345
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2620014249
- Cited by
- 173
- References
- 85
- FWCI
- 19.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.