The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
The effectiveness of nudging: A meta-analysis of choice architecture interventions across behavioral domains
Open accessAbstract
Significance: Changing individuals’ behavior is key to tackling some of today’s most pressing societal challenges such as the COVID-19 pandemic or climate change. Choice architecture interventions aim to nudge people toward personally and socially desirable behavior through the design of choice environments. Although increasingly popular, little is known about the overall effectiveness of choice architecture interventions and the conditions under which they facilitate behavior change. Here we quantitatively review over a decade of research, showing that choice architecture interventions successfully promote behavior change across key behavioral domains, populations, and locations. Our findings offer insights into the effects of choice architecture and provide guidelines for behaviorally informed policy making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“All analyses were conducted in R using the package metafor (80).”
MethodWang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
New Environmental Theories: Toward a Coherent Theory of Environmentally Significant Behavior
Stern, P. C. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00175 · Cited by 8,682
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Nudge: Improving Decisions About Health, Wealth and Happiness
Adkisson, R. V. (2008) · The Social Science Journal · doi:10.1016/j.soscij.2008.09.003 · Cited by 5,543
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
A Practitioner’s Guide to Cluster-Robust Inference
Colin Cameron, A., & Miller, D. L. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.317 · Cited by 5,037 · cited 1×
“, in cases where multiple treatment conditions were compared to the same control condition), we computed cluster-robust SEs, confidence intervals, and statistical tests for the estimated effect sizes (78, 79).”
MethodModels of Bounded Rationality: Empirically Grounded Economic Reason
Simon, H. A. (1997) · The MIT Press eBooks · doi:10.7551/mitpress/4711.001.0001 · Cited by 4,205
Gigerenzer, G., & Gaissmaier, W. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145346 · Cited by 4,037
Social norms and energy conservation
Allcott, H. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.03.003 · Cited by 2,802 · cited 3×
“In a natural field experiment with more than 600,000 US households, for instance, Allcott (18) demonstrated the effectiveness of descriptive social norms in promoting energy conservation.”
BackgroundInfluentialA review of intervention studies aimed at household energy conservation
Abrahamse, W., Steg, L., Vlek, C., & Rothengatter, T. (2005) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2005.08.002 · Cited by 2,668
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
Save More Tomorrow™: Using Behavioral Economics to Increase Employee Saving
Thaler, R. H., & Benartzi, S. (2004) · Journal of Political Economy · doi:10.1086/380085 · Cited by 2,483
Sheeran, P., & Webb, T. L. (2016) · Social and Personality Psychology Compass · doi:10.1111/spc3.12265 · Cited by 2,185 · cited 1×
“Even if people make a deliberate and potentially rational decision to change their behavior, limited attentional capacities and a lack of self-control may prevent this decision from actually translating into the desired actions, a phenomenon described as the intention–behavior gap (26).”
BackgroundHarrison, G. W., & List, J. A. (2004) · Journal of Economic Literature · doi:10.1257/0022051043004577 · Cited by 2,099
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · cited 1×
“, in cases where multiple treatment conditions were compared to the same control condition), we computed cluster-robust SEs, confidence intervals, and statistical tests for the estimated effect sizes (78, 79).”
MethodBasics of meta‐analysis: I 2 is not an absolute measure of heterogeneity
Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1230 · Cited by 1,848
Behavioral Decision Research: A Constructive Processing Perspective
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1992) · Annual Review of Psychology · doi:10.1146/annurev.ps.43.020192.000511 · Cited by 1,448
Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
Interventions to Break and Create Consumer Habits
Verplanken, B., & Wood, W. (2006) · Journal of Public Policy & Marketing · doi:10.1509/jppm.25.1.90 · Cited by 1,221
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130
The Influence of Framing on Risky Decisions: A Meta-analysis
Kühberger, A. (1998) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1998.2781 · Cited by 1,121
Nutrition labels on pre-packaged foods: a systematic review
Campos, S., Doxey, J., & Hammond, D. (2011) · Public Health Nutrition · doi:10.1017/s1368980010003290 · Cited by 937
Should Governments Invest More in Nudging?
Benartzi, S., Beshears, J., Milkman, K. L., Sunstein, C. R., Thaler, R. H., Shankar, M., Tucker-Ray, W., Congdon, W. J., & Galing, S. (2017) · Psychological Science · doi:10.1177/0956797617702501 · Cited by 861
The Construction of Preference
(2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511618031 · Cited by 785
Knowledge is (Less) Power: Experimental Evidence from Residential Energy Use
Jessoe, K., & Rapson, D. (2014) · American Economic Review · doi:10.1257/aer.104.4.1417 · Cited by 565
Hummel, D., & Maedche, A. (2019) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2019.03.005 · Cited by 543
Behavioural science is unlikely to change the world without a heterogeneity revolution
Bryan, C. J., Tipton, E., & Yeager, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01143-3 · Cited by 537
SNYDER, L. B., HAMILTON, M. A., MITCHELL, E. W., KIWANUKA-TONDO, J., FLEMING-MILICI, F., & PROCTOR, D. (2004) · Journal of Health Communication · doi:10.1080/10810730490271548 · Cited by 535
Which Healthy Eating Nudges Work Best? A Meta-Analysis of Field Experiments
Cadario, R., & Chandon, P. (2020) · Marketing Science · doi:10.1287/mksc.2018.1128 · Cited by 504
When and why defaults influence decisions: a meta-analysis of default effects
JACHIMOWICZ, J. M., DUNCAN, S., WEBER, E. U., & JOHNSON, E. J. (2019) · Behavioural Public Policy · doi:10.1017/bpp.2018.43 · Cited by 481
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461 · cited 2×
“3) revealed an asymmetric distribution that suggested a one-tailed overrepresentation of positive effect sizes in studies with comparatively low statistical power (43).”
BackgroundMethodMeta-analysis of multiple outcomes: a multilevel approach
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0527-2 · Cited by 450
Albarracin, D., & Shavitt, S. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011911 · Cited by 446
Site Selection Bias in Program Evaluation *
Allcott, H. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv015 · Cited by 426
Hsee, C. K., & Zhang, J. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610374586 · Cited by 410
Evaluating the Impact of Menu Labeling on Food Choices and Intake
Roberto, C. A., Larsen, P. D., Agnew, H., Baik, J., & Brownell, K. D. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.160226 · Cited by 407
Sizing up the Effect of Portion Size on Consumption: A Meta-Analytic Review
Zlatevska, N., Dubelaar, C., & Holden, S. S. (2014) · Journal of Marketing · doi:10.1509/jm.12.0303 · Cited by 378
A Dirty Word or a Dirty World?: Attribute Framing, Political Affiliation, and Query Theory
Hardisty, D. J., Johnson, E. J., & Weber, E. U. (2010) · Psychological Science · doi:10.1177/0956797609355572 · Cited by 370
Larrick, R. P., & Soll, J. B. (2008) · Science · doi:10.1126/science.1154983 · Cited by 363
Nisa, C. F., Bélanger, J. J., Schumpe, B. M., & Faller, D. G. (2019) · Nature Communications · doi:10.1038/s41467-019-12457-2 · Cited by 349
A Review and Taxonomy of Choice Architecture Techniques
Münscher, R., Vetter, M., & Scheuerle, T. (2016) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1897 · Cited by 348
Partitioning default effects: Why people choose not to choose.
Dinner, I., Johnson, E. J., Goldstein, D. G., & Liu, K. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0024354 · Cited by 340
Szaszi, B., Palinkas, A., Palfi, B., Szollosi, A., & Aczel, B. (2018) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2035 · Cited by 322
Nudging out support for a carbon tax
Hagmann, D., Ho, E. H., & Loewenstein, G. (2019) · Nature Climate Change · doi:10.1038/s41558-019-0474-0 · Cited by 278
Mantzari, E., Vogt, F., Shemilt, I., Wei, Y., Higgins, J. P. T., & Marteau, T. M. (2015) · Preventive Medicine · doi:10.1016/j.ypmed.2015.03.001 · Cited by 277
Slovic, P. (1972) · PsycEXTRA Dataset · doi:10.1037/e310462005-001 · Cited by 272
Use caution when applying behavioural science to policy
IJzerman, H., Lewis, N. A., Przybylski, A. K., Weinstein, N., DeBruine, L., Ritchie, S. J., Vazire, S., Forscher, P. S., Morey, R. D., Ivory, J. D., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00990-w · Cited by 262
Framing of information: Its influence upon decisions of doctors and patients
Marteau, T. M. (1989) · British Journal of Social Psychology · doi:10.1111/j.2044-8309.1989.tb00849.x · Cited by 232
THALER, R. H., SUNSTEIN, C. R., & BALZ, J. P. (2018) · The Behavioral Foundations of Public Policy · doi:10.2307/j.ctv550cbm.31 · Cited by 214
LOEWENSTEIN, G., & CHATER, N. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.7 · Cited by 211
Can Small Incentives Have Large Effects? The Impact of Taxes versus Bonuses on Disposable Bag Use
Homonoff, T. A. (2018) · American Economic Journal Economic Policy · doi:10.1257/pol.20150261 · Cited by 207
Maki, A., Burns, R. J., Ha, L., & Rothman, A. J. (2016) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2016.07.006 · Cited by 201
Nudging: Progress to date and future directions
Beshears, J., & Kosowsky, H. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.09.001 · Cited by 198
RCTs to Scale: Comprehensive Evidence from Two Nudge Units
DellaVigna, S., & Linos, E. (2020) · National Bureau of Economic Research · doi:10.3386/w27594 · Cited by 189
Easy does it: The role of fluency in cue weighting: (722852011-015)
Shah, A. K., & Oppenheimer, D. M. (2007) · PsycEXTRA Dataset · doi:10.1037/e722852011-015 · Cited by 169
People Prefer System 2 Nudges (Kind Of)
Sunstein, C. R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2731868 · Cited by 168
McCaffery, E. J., & Baron, J. (2006) · Psychology Public Policy and Law · doi:10.1037/1076-8971.12.1.106 · Cited by 168
Do Nudges Reduce Disparities? Choice Architecture Compensates for Low Consumer Knowledge
Mrkva, K., Posner, N. A., Reeck, C., & Johnson, E. J. (2021) · Journal of Marketing · doi:10.1177/0022242921993186 · Cited by 150
What we can learn from five naturalistic field experiments that failed to shift commuter behaviour
Kristal, A. S., & Whillans, A. V. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0795-z · Cited by 129
Do distant foods decrease intake? The effect of food accessibility on consumption
Maas, J., de Ridder, D. T. D., de Vet, E., & de Wit, J. B. F. (2011) · Psychology and Health · doi:10.1080/08870446.2011.565341 · Cited by 126
Identifying and Quantifying Heterogeneity
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386.ch16 · Cited by 113
Mental accounting mechanisms in energy decision-making and behaviour
Hahnel, U. J. J., Chatelain, G., Conte, B., Piana, V., & Brosch, T. (2020) · Nature Energy · doi:10.1038/s41560-020-00704-6 · Cited by 97
Self-citationThe distributional effects of nudges
Sunstein, C. R. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01236-z · Cited by 96
Ghesla, C., Grieder, M., & Schubert, R. (2019) · Energy Economics · doi:10.1016/j.eneco.2019.104616 · Cited by 72
Venema, T. A. G., Kroese, F. M., Verplanken, B., & de Ridder, D. T. D. (2020) · Appetite · doi:10.1016/j.appet.2020.104699 · Cited by 36
Johnson, E. J., & Goldstein, D. (2003) · Science · doi:10.1126/science.1091721 · Cited by 35
Shaping online consumer choice by partitioning the Web
Martin, J. M., & Norton, M. I. (2009) · Psychology and Marketing · doi:10.1002/mar.20305 · Cited by 33
Testing Strategies to Increase Saving and Retention in Individual Development Account ProgramsPreprint
Loibl, C., Jones, L. E., Haisley, E., & Loewenstein, G. (2016) · SSRN Electronic Journal · doi:10.1016/j.joep.2018.04.002 · Cited by 29
This way, please: Uncovering the directional effects of attribute translations on decision making
Mertens, S., Hahnel, U. J. J., & Brosch, T. (2020) · Judgment and Decision Making · doi:10.1017/s1930297500006896 · Cited by 28
Self-citationNudging persistence after failure through emergency reserves
Sharif, M. A., & Shu, S. B. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2019.01.004 · Cited by 25
Exploring the underpinning mechanisms of the proximity effect within a competitive food environment
Knowles, D., Brown, K. G., & Aldrovandi, S. (2018) · Appetite · doi:10.1016/j.appet.2018.12.005 · Cited by 17
Cited by
Chater, N., & Loewenstein, G. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002023 · Cited by 710
The effects of social isolation stress and discrimination on mental health
Brandt, L., Liu, S., Heim, C., & Heinz, A. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-02178-4 · Cited by 418
van Valkengoed, A. M., Abrahamse, W., & Steg, L. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01473-w · Cited by 316
No evidence for nudging after adjusting for publication bias
Maier, M., Bartoš, F., Stanley, T. D., Shanks, D. R., Harris, A. J. L., & Wagenmakers, E.-J. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2200300119 · Cited by 284
Understanding health behavior change by motivation and reward mechanisms: a review of the literature
Michaelsen, M. M., & Esch, T. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1151918 · Cited by 114
Metadata
- Authors
- Mertens, S., Herberz, M., Hahnel, U. J. J., & Brosch, T.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2021-12-30
- Volume
- 119
- Issue
- 1
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W4205744578
- Cited by
- 738
- References
- 78
- FWCI
- 14.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.