The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
What Motivates Effort? Evidence and Expert Forecasts
Abstract
How much do different monetary and non-monetary motivators induce costly effort? Does the effectiveness line up with the expectations of researchers and with results in the literature? We conduct a large-scale real-effort experiment with eighteen treatment arms. We examine the effect of (1) standard incentives; (2) behavioural factors like social preferences and reference dependence; and (3) non-monetary inducements from psychology. We find that (1) monetary incentives work largely as expected, including a very low piece rate treatment which does not crowd out effort; (2) the evidence is partly consistent with standard behavioural models, including warm glow, though we do not find evidence of probability weighting; (3) the psychological motivators are effective, but less so than incentives. We then compare the results to forecasts by 208 academic experts. On average, the experts anticipate several key features, like the effectiveness of psychological motivators. A sizeable share of experts, however, expects crowd-out, probability weighting, and pure altruism, counterfactually. As a further comparison, we present a meta-analysis of similar treatments in the literature. Overall, predictions based on the literature are correlated with, but underperform, the expert forecasts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Maslow, A. H. (1943) · Psychological Review · doi:10.1037/h0054346 · Cited by 21,563
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467
(2017) · Defining and Classifying Children in Need · doi:10.4324/9781315258324-16 · Cited by 11,320
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Time Discounting and Time Preference: A Critical Review
Frederick, S., Loewenstein, G. F., & O’Donoghue, T. (2002) · Journal of Economic Literature · doi:10.1257/002205102320161311 · Cited by 6,381
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122
Impure Altruism and Donations to Public Goods: A Theory of Warm-Glow Giving
Andreoni, J. (1990) · The Economic Journal · doi:10.2307/2234133 · Cited by 5,825
Effects of externally mediated rewards on intrinsic motivation.
Deci, E. L. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030644 · Cited by 4,170
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
The Constructive, Destructive, and Reconstructive Power of Social Norms
Schultz, P. W., Nolan, J. M., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01917.x · Cited by 3,643
Fairness and retaliation: the economics of reciprocity
Fehr, E., & Gächter, S. (2000) · Journal of Economic Perspectives · doi:10.1257/jep.14.3.159 · Cited by 3,239
Giving with Impure Altruism: Applications to Charity and Ricardian Equivalence
Andreoni, J. (1989) · Journal of Political Economy · doi:10.1086/261662 · Cited by 3,162
O'Donoghue, T., & Rabin, M. (1999) · American Economic Review · doi:10.1257/aer.89.1.103 · Cited by 3,121
Rabin, M. (1997) · Journal of Economic Literature · Cited by 3,079
A Theory of Social Interactions
Becker, G. S. (1974) · Journal of Political Economy · doi:10.1086/260265 · Cited by 2,969
A Model of Reference-Dependent Preferences
Koszegi, B., & Rabin, M. (2006) · The Quarterly Journal of Economics · doi:10.1093/qje/121.4.1133 · Cited by 2,728
A Theory of Social Interactions
Becker, G. (1974) · National Bureau of Economic Research · doi:10.3386/w0042 · Cited by 2,530
Psychology and Economics: Evidence from the Field
DellaVigna, S. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.2.315 · Cited by 2,365
Self-citationPay Enough or Don't Pay at All*
Gneezy, U., & Rustichini, A. (2000) · Quarterly Journal of Economics · doi:10.1162/003355300554917 · Cited by 2,175
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
The Probability Weighting Function
Prelec, D. (1998) · Econometrica · doi:10.2307/2998573 · Cited by 1,983
The Online Laboratory: Conducting Experiments in a Real Labor Market∗Preprint
Zeckhauser, R. J. (2016) · Cited by 1,529
Does Fairness Prevent Market Clearing? An Experimental Investigation
Fehr, E., Kirchsteiger, G., & Riedl, A. (1993) · The Quarterly Journal of Economics · doi:10.2307/2118338 · Cited by 1,506
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314 · cited 3×
“The NLS model, as (12) stresses, matches the expected log effort, while the minimum-distance matches the log of expected effort (given the assumed homogeneity).”
InfluentialExpert political judgment: how good is it? how can we know?
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3634 · Cited by 1,260 · cited 1×
“2There is a larger literature on forecasting about topics other than research results, e.g., the Good Judgment Project on national security (Tetlock, 2010 and Tetlock and Gardner, 2015).”
Grant, A. M. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.1.108 · Cited by 1,114
Testing for Altruism and Social Pressure in Charitable Giving
DellaVigna, S., List, J. A., & Malmendier, U. (2012) · The Quarterly Journal of Economics · doi:10.1093/qje/qjr050 · Cited by 1,080
Self-citationPROBABILITY WEIGHTING FUNCTIONPreprint
al‐Nowaihi, A., & Dhami, S. (2005) · SSRN Electronic Journal · Cited by 1,077
How Elastic Are Preferences for Redistribution? Evidence from Randomized Survey Experiments
Kuziemko, I., Norton, M. I., Saez, E., & Stantcheva, S. (2015) · American Economic Review · doi:10.1257/aer.20130360 · Cited by 1,067
Who are the crowdworkers?: shifting demographics in mechanical turk
Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1753873 · Cited by 1,004
Curvature of the Probability Weighting Function
Wu, G., & Gonzalez, R. (1996) · Management Science · doi:10.1287/mnsc.42.12.1676 · Cited by 987
Superforecasting: the art and science of prediction
(2016) · Choice Reviews Online · doi:10.5860/choice.196400 · Cited by 919
Analyzing the Amazon Mechanical Turk marketplace
Ipeirotis, P. G. (2010) · XRDS: Crossroads, The ACM Magazine for Students · doi:10.1145/1869086.1869094 · Cited by 879
Gneezy, U., & List, J. A. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00707.x · Cited by 699
Estimating Time Preferences from Convex Budgets
Andreoni, J., & Sprenger, C. (2012) · American Economic Review · doi:10.1257/aer.102.7.3333 · Cited by 665
The labor economics of paid crowdsourcing
Horton, J. J., & Chilton, L. B. (2010) · Proceedings of the 11th ACM conference on Electronic commerce · doi:10.1145/1807342.1807376 · Cited by 601
What's Advertising Content Worth? Evidence from a Consumer Credit Marketing Field Experiment*
Bertrand, M., Karlan, D., Mullainathan, S., Shafir, E., & Zinman, J. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.263 · Cited by 547
Asymmetric Paternalism to Improve Health Behaviors
Loewenstein, G., Brennan, T., & Volpp, K. G. (2007) · JAMA · doi:10.1001/jama.298.20.2415 · Cited by 533
Jacob, B. A., & Lefgren, L. (2008) · Journal of Labor Economics · doi:10.1086/522974 · Cited by 494
Working over Time: Dynamic Inconsistency in Real Effort Tasks *
Augenblick, N., Niederle, M., & Sprenger, C. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv020 · Cited by 483
(2014) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 464
Choosing the Right Pond: Human Behavior and the Quest for Status.
Wagner, D. G., & Frank, R. H. (1986) · Contemporary Sociology · doi:10.2307/2070056 · Cited by 411
The Behavioralist Visits the Factory: Increasing Productivity Using Simple Framing Manipulations
Hossain, T., & List, J. A. (2012) · Management Science · doi:10.1287/mnsc.1120.1544 · Cited by 385
Estimating Discount Functions with Consumption Choices over the Lifecycle
Laibson, D., Lee, S. C., Maxted, P., Repetto, A., & Tobacman, J. (2007) · National Bureau of Economic Research · doi:10.3386/w13314 · Cited by 360
The Nature of Risk Preferences: Evidence from Insurance Choices
Barseghyan, L., Molinari, F., O'Donoghue, T., & Teitelbaum, J. C. (2013) · American Economic Review · doi:10.1257/aer.103.6.2499 · Cited by 348
Using prediction markets to estimate the reproducibility of scientific research
Dreber, A., Pfeiffer, T., Almenberg, J., Isaksson, S., Wilson, B., Chen, Y., Nosek, B. A., & Johannesson, M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1516179112 · Cited by 331
A choice prediction competition: Choices from experience and from description
Erev, I., Ert, E., Roth, A. E., Haruvy, E., Herzog, S. M., Hau, R., Hertwig, R., Stewart, T., West, R., & Lebiere, C. (2010) · Journal of Behavioral Decision Making · doi:10.1002/bdm.683 · Cited by 329
Reference-Dependent Preferences: Evidence from Marathon Runners
Allen, E. J., Dechow, P. M., Pope, D. G., & Wu, G. (2017) · Management Science · doi:10.1287/mnsc.2015.2417 · Cited by 324
Self-citationKőszegi, B. (2014) · Journal of Economic Literature · doi:10.1257/jel.52.4.1075 · Cited by 317
TEAM INCENTIVES: EVIDENCE FROM A FIRM LEVEL EXPERIMENT
Bandiera, O., Barankay, I., & Rasul, I. (2013) · Journal of the European Economic Association · doi:10.1111/jeea.12028 · Cited by 315
Partisan Impacts on the Economy: Evidence from Prediction Markets and Close Elections
Snowberg, E., Wolfers, J., & Zitzewitz, E. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.2.807 · Cited by 290
Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment
Fryer, R., Levitt, S., List, J., & Sadoff, S. (2012) · National Bureau of Economic Research · doi:10.3386/w18237 · Cited by 272
Projection Bias in Catalog Orders
Conlin, M., O'Donoghue, T., & Vogelsang, T. J. (2007) · American Economic Review · doi:10.1257/aer.97.4.1217 · Cited by 253
How Much Can We Generalize From Impact Evaluations?
Vivalt, E. (2020) · Journal of the European Economic Association · doi:10.1093/jeea/jvaa019 · Cited by 237
Identifying and Cultivating Superforecasters as a Method of Improving Probabilistic Predictions
Mellers, B., Stone, E., Murray, T., Minster, A., Rohrbaugh, N., Bishop, M., Chen, E., Baker, J., Hou, Y., Horowitz, M., et al. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615577794 · Cited by 236
Kaur, S., Kremer, M., & Mullainathan, S. (2015) · Journal of Political Economy · doi:10.1086/683822 · Cited by 232
Working for the “warm glow”: On the benefits and limits of prosocial incentives
Imas, A. (2014) · Journal of Public Economics · doi:10.1016/j.jpubeco.2013.11.006 · Cited by 222
Berger, J., & Pope, D. (2011) · Management Science · doi:10.1287/mnsc.1110.1328 · Cited by 215
Self-citationPredicting Experimental Results: Who Knows What?
DellaVigna, S., & Pope, D. (2018) · Journal of Political Economy · doi:10.1086/699976 · Cited by 183
Self-citationCorporate Philanthropy and Productivity: Evidence from an Online Real Effort Experiment
Tonin, M., & Vlassopoulos, M. (2014) · Management Science · doi:10.1287/mnsc.2014.1985 · Cited by 152
The Role of Theory in Field Experiments
Card, D., DellaVigna, S., & Malmendier, U. M. (2011) · The Journal of Economic Perspectives · doi:10.1257/jep.25.3.39 · Cited by 148
Self-citationPredicting Experimental Results: Who Knows What?
DellaVigna, S., & Pope, D. G. (2016) · National Bureau of Economic Research · doi:10.3386/w22566 · Cited by 124
Self-citationAmir, O., & Dan Ariely, C. (2006) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0012857 · Cited by 124
Estimating Social Preferences and Gift Exchange at Work
DellaVigna, S., List, J. A., Malmendier, U. M., & Rao, G. (2016) · National Bureau of Economic Research · doi:10.3386/w22043 · Cited by 104
Self-citationEstimating Social Preferences and Gift Exchange at Work
DellaVigna, S., List, J. A., Malmendier, U. M., & Rao, G. (2022) · American Economic Review · doi:10.1257/aer.20190920 · Cited by 104
Self-citationGroh, M., Krishnan, N., McKenzie, D. J., & Vishwanath, T. (2016) · IZA Journal of Labor & Development · doi:10.1186/s40175-016-0055-9 · Cited by 94
Decision Theoretic Approaches to Experiment Design and External Validity
Banerjee, A., Chassang, S., & Snowberg, E. (2017) · Handbook of economic field experiments · doi:10.1016/bs.hefe.2016.08.005 · Cited by 83
ON THE RELATIVE EFFICIENCY OF PERFORMANCE PAY AND NONCONTINGENT INCENTIVES
Uri Gneezy, B., & Rey‐Biel, P. (2014) · Journal of the European Economic Association · doi:10.1111/jeea.12062 · Cited by 55
Loss Aversion Motivates Tax Sheltering: Evidence from U.S. Tax ReturnsPreprint
Rees-Jones, A. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2330980 · Cited by 33
How Soon Is Now? Evidence of Present Bias from Convex Time Budget Experiments
Balakrishnan, U., Haushofer, J., & Jakiela, P. (2017) · National Bureau of Economic Research · doi:10.3386/w23558 · Cited by 32
How Soon is Now? Evidence of Present Bias from Convex Time Budget ExperimentsPreprint
Balakrishnan, U., Haushofer, J., & Jakiela, P. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2716594 · Cited by 10
Cited by
Measuring and Bounding Experimenter Demand
de Quidt, J., Haushofer, J., & Roth, C. (2018) · American Economic Review · doi:10.1257/aer.20171330 · Cited by 568
RCTs to Scale: Comprehensive Evidence From Two Nudge Units
DellaVigna, S., & Linos, E. (2022) · Econometrica · doi:10.3982/ecta18709 · Cited by 480
Self-citationGabaix, X. (2019) · Handbook of Behavioral Economics: Applications and Foundations 1 · doi:10.1016/bs.hesbe.2018.11.001 · Cited by 329
Nonmonetary Incentives and the Implications of Work as a Source of Meaning
Cassar, L., & Meier, S. (2018) · Journal of Economic Perspectives · doi:10.1257/jep.32.3.215 · Cited by 288
Are Referees and Editors in Economics Gender Neutral?*
Card, D., DellaVigna, S., Funk, P., & Iriberri, N. (2020) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz035 · Cited by 279
Self-citation
Metadata
- Authors
- DellaVigna, S., & Pope, D.
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-06-05
- Volume
- 85
- Issue
- 2
- Pages
- 1029-1069
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2346258676
- Cited by
- 392
- References
- 74
- FWCI
- 89.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.