CoChat
Sign Up
Cited by 30

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Has the evidence for moral licensing been inflated by publication bias?

Kuper, Niclas, Bott, Antonia·2019·Meta-Psychology
DOI 10.15626/mp.2018.878
Open this paper in CoChat — free account

Abstract

Moral licensing describes the phenomenon that displaying moral behavior can lead to subsequent immoral behavior. This is usually explained by the idea that an initial moral act affirms the moral self-image and hence licenses subsequent immoral acts. Previous meta-analyses on moral licensing indicate significant overall effects of d> .30. However, several large replication studies have either not found the effect or reported a substantially smaller effect size. The present article investigated whether this can be attributed to publication bias. Datasets from two previous meta-analyses on moral licensing were compared and when necessary modified. The larger dataset was used for the present analyses. Using PET-PEESE and a three-parameter-selection-model (3-PSM), we found some evidence for publication bias. The adjusted effect sizes were reduced to d= -0.05, p= .64 and d= 0.18, p= .002, respectively. While the first estimate could be an underestimation, we also found indications that the second estimate might exaggerate the true effect size. It is concluded that both the evidence for and the size of moral licensing effects has likely been inflated by publication bias. Furthermore, our findings indicate that culture moderates the moral licensing effect. Recommendations for future meta-analytic and empirical work are given. Subsequent studies on moral licensing should be adequately powered and ideally pre-registered.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.15626/mp.2018.878

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 39

  1. Baumeister, R. F., Bratslavsky, E., Muraven, M., & Tice, D. M. (1998). Ego depletion: Is the active self a limited resource?. Journal of personality and social psychology, 74, 1252-1265. · DOI · Paper page
  2. Becker, B. J. (2005). Failsafe N or file-drawer number. In H. R. Rothstein, A. J. Sutton, & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 111- 125). Chichester, England: John Wiley & Sons. · DOI
  3. Bem, D. J. (1972). Self-perception theory. Advances in experimental social psychology, 6, 1-62. · DOI · Paper page
  4. Blanken, I., van de Ven, N., Zeelenberg, M., & Meijers, M. H. (2014). Three attempts to replicate the moral licensing effect. Social Psychology, 45, 232-238. · DOI
  5. Blanken, I., van de Ven, N., & Zeelenberg, M. (2015). A meta-analytic review of moral licensing. Personality and Social Psychology Bulletin, 41, 540- 558. · DOI
  6. *Bradley-Geist, J. C., King, E. B., Skorinko, J., Hebl, M. R., & McKenna, C. (2010). Moral credentialing by association: The importance of choice and relationship closeness. Personality and Social Psychology Bulletin, 36, 1564-1575. · DOI
  7. Carter, E. C., & McCullough, M. E. (2014). Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?. Frontiers in psychology, 5, 823. · DOI · Paper page
  8. Clot, S., Grolleau, G., & Ibanez, L. (2014). Smug alert! Exploring self-licensing behavior in a cheating game. Economics Letters, 123, 191-194. · DOI
  9. Conway, P., & Peetz, J. (2012). When does feeling moral actually make you a better person? Conceptual abstraction moderates whether past moral deeds motivate consistency or compensatory behavior. Personality and Social Psychology Bulletin, 38, 907-919. · DOI
  10. Duval, S., & Tweedie, R. (2000). Trim and fill: a simple funnel‐plot-based method of testing and adjusting for publication bias in meta‐analysis. Biometrics, 56, 455-463. · DOI · Paper page
  11. Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., ... & Brown, E. R. (2016). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Journal of Experimental Social Psychology, 67, 68-82. · DOI · Paper page
  12. *Effron, D. A. (2014). Making mountains of morality from molehills of virtue: Threat causes people to overestimate their moral credentials. Personality and Social Psychology Bulletin, 40, 972-985. · DOI
  13. *Effron, D. A., Monin, B., & Miller, D. T. (2012). Inventing racist roads not taken: The licensing effect of immoral counterfactual behaviors. Journal of Personality and Social Psychology, 103, 916-932. · DOI
  14. Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. Bmj, 315, 629-634. · DOI · Paper page
  15. Etherton, J. L., Osborne, R., Stephenson, K., Grace, M., Jones, C., & De Nadai, A. (2018). Bayesian analysis of multimethod ego‐depletion studies favours the null hypothesis. British Journal of Social Psychology, 57, 367-385. · DOI
  16. Ferguson, C. J., & Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science's aversion to the null. Perspectives on Psychological Science, 7, 555-561. · DOI · Paper page
  17. Francis, G. (2012). Publication bias and the failure of replication in experimental psychology. Psychonomic Bulletin & Review, 19, 975-991. · DOI
  18. Hagger, M. S., Chatzisarantis, N. L., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., ... & Calvillo, D. P. (2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546-573. · DOI
  19. Hedges, L. V., & Vevea, J. L. (1996). Estimating effect size under publication bias: small sample properties and robustness of a random effects selection model. Journal of Educational and Behavioral Statistics, 21, 299-332. · DOI
  20. Iyengar, S., & Greenhouse, J. B. (1988). Selection models and the file drawer problem. Statistical Science, 3, 109-117. · DOI
  21. *Jordan, J., Mullen, E., & Murnighan, J. K. (2011). Striving for the moral self: The effects of recalling past moral actions on future moral behavior. Personality and Social Psychology Bulletin, 37, 701-713. · DOI
  22. *Kouchaki, M. (2011). Vicarious moral licensing: The influence of others' past moral actions on moral behavior. Journal of personality and social psychology, 101, 702-715. · DOI
  23. López‐López, J. A., Van den Noortgate, W., Tanner‐ Smith, E. E., Wilson, S. J., & Lipsey, M. W. (2017). Assessing meta‐regression methods for examining moderator relationships with dependent effect sizes: A Monte Carlo simulation. Research synthesis methods, 8, 435-450. · DOI
  24. Mazar, N., & Zhong, C. B. (2010). Do green products make us better people?. Psychological science, 21, 494-498. · DOI
  25. *Meijers, M. H. C., Noordewier, M. K., Verlegh, P. W. J., & Smit, E. G. (2014). Identity relevance moderates the licensing effect (Chapter from doctoral dissertation, Amsterdam School of Communication Research). Retrieved from http://dare.uva.nl/record/1/432499
  26. Merritt, A. C., Effron, D. A., & Monin, B. (2010). Moral self‐licensing: When being good frees us to be bad. Social and personality psychology compass, 4, 344-357. · DOI
  27. R Foundation for Statistical Computing Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638-641. · DOI · Paper page
  28. Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2005). Publication bias in meta-analysis: Prevention, assessment and adjustments. Chichester, England: John Wiley & Sons. · DOI · Paper page
  29. Sachdeva, S., Iliev, R., & Medin, D. L. (2009). Sinning saints and saintly sinners: The paradox of moral self-regulation. Psychological science, 20, 523- 528. Scargle, J. D. (2000). Publication Bias: The "FileDrawer" Problem in Scientific Inference. Journal of Scientific Exploration, 14, 91-106. · DOI
  30. Schonemann, P. H., & Scargle, J. D. (2008). A Generalized Publication Bias Model. Chinese Journal of Psychology, 50, 21-29.
  31. Simbrunner, P., & Schlegelmilch, B. B. (2017). Moral licensing: a culture-moderated meta-analysis. Management Review Quarterly, 67, 201-225. · DOI
  32. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological science, 22, 1359-1366. · DOI · Paper page
  33. Susewind, M., & Hoelzl, E. (2014). A matter of perspective: Why past moral behavior can sometimes encourage and other times discourage future moral striving. Journal of Applied Social Psychology, 44, 201-209. · DOI
  34. Triandis, H. C. (2018). Introduction: Two constructs. In R. Nisbett (Ed.), Individualism and collectivism (pp.1-18). New York, NY: Routledge. · DOI
  35. Triandis, H. C. (2001). Individualism‐collectivism and personality. Journal of personality, 69, 907-924. · DOI · Paper page
  36. Urban, J., Bahník, Š., & Kohlová, M. B. (2017, December 19). Green consumption does not make people cheat: Three replications of a moral licensing experiment. http://doi.org/10.17605/OSF.IO/WYNJB · DOI
  37. Vevea, J. L., & Hedges, L. V. (1995). A general linear model for estimating effect size in the presence of publication bias. Psychometrika, 60, 419-435. Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36, 1-48. · DOI
  38. *Young, Y., Chakroff, A., & Tom, J. (2012). Doing good leads to more good: The reinforcing power of a moral self-concept. Review of Philosophy and Psychology, 3, 325-334. · DOI
  39. Zhong, C., & Liljenquist, K. (2006). Washing away your sins: Threatened morality and physical cleansing. Science, 313, 1451-1452. · DOI

Metadata

Authors
Kuper, N., & Bott, A.
Venue
Meta-Psychology
Publisher
Linnaeus University
Published
2019-05-14
Volume
3
ISSN
2003-2714
DOI
10.15626/mp.2018.878
Cited by
30
References
14
Licence
creativecommons.org/licenses/by/4.0 (unspecified)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review