CoChat

Meta-analyses of positive psychology interventions: The effects are much smaller than previously reported

Open access
White, Carmela A., Uttl, Bob, Holder, Mark D. · 2019 · PLOS ONE
Cited by 200

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.

Abstract

For at least four decades, researchers have studied the effectiveness of interventions designed to increase well-being. These interventions have become known as positive psychology interventions (PPIs). Two highly cited meta-analyses examined the effectiveness of PPIs on well-being and depression: Sin and Lyubomirsky (2009) and Bolier et al. (2013). Sin and Lyubomirsky reported larger effects of PPIs on well-being (r = .29) and depression (r = .31) than Bolier et al. reported for subjective well-being (r = .17), psychological well-being (r = .10), and depression (r = .11). A detailed examination of the two meta-analyses reveals that the authors employed different approaches, used different inclusion and exclusion criteria, analyzed different sets of studies, described their methods with insufficient detail to compare them clearly, and did not report or properly account for significant small sample size bias. The first objective of the current study was to reanalyze the studies selected in each of the published meta-analyses, while taking into account small sample size bias. The second objective was to replicate each meta-analysis by extracting relevant effect sizes directly from the primary studies included in the meta-analyses. The present study revealed three key findings: (1) many of the primary studies used a small sample size; (2) small sample size bias was pronounced in many of the analyses; and (3) when small sample size bias was taken into account, the effect of PPIs on well-being were small but significant (approximately r = .10), whereas the effect of PPIs on depression were variable, dependent on outliers, and generally not statistically significant. Future PPI research needs to focus on increasing sample sizes. A future meta-analyses of this research needs to assess cumulative effects from a comprehensive collection of primary studies while being mindful of issues such as small sample size bias.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0216588

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 62 references

Research works printed but not linked: 57

  1. S Schueller, 2014, Synthesizing positive psychological interventions: Suggestions for conducting and interpreting meta-analyses, Int J Wellbeing, 4, 10.5502/ijw.v4i1.5 · DOI · Paper page
  2. M Borenstein, 2009, Introduction to Meta-Analysis, 10.1002/9780470743386 · DOI · Paper page
  3. WP Dunlap, 1996, Meta-analysis of experiments with matched groups or repeated measures designs, Psychol Methods, 1, 170, 10.1037/1082-989X.1.2.170 · DOI · Paper page
  4. S Duval, 2000, Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis, Biometrics, 56, 455, 10.1111/j.0006-341X.2000.00455.x · DOI · Paper page
  5. M Borenstein, 2009, Introduction to Meta-Analysis, 10.1002/9780470743386 · DOI · Paper page
  6. CM Burton, 2004, The health benefits of writing about intensely positive experiences, J Res Personal, 38, 150, 10.1016/S0092-6566(03)00058-8 · DOI · Paper page
  7. EA Cook, 1998, Effects of reminiscence on life satisfaction of elderly female nursing home residents, Health Care Women Int, 19, 109, 10.1080/073993398246449 · DOI · Paper page
  8. MC Davis, 2004, Life review therapy as an intervention to manage depression and enhance life satisfaction in individuals with right hemisphere cerebral vascular accidents, Issues Ment Health Nurs, 25, 503, 10.1080/01612840490443455 · DOI · Paper page
  9. MW Fordyce, 1983, A program to increase happiness: Further studies, J Couns Psychol, 30, 483, 10.1037/0022-0167.30.4.483 · DOI · Paper page
  10. SR Freedman, 1996, Forgiveness as an intervention goal with incest survivors, J Consult Clin Psychol, 64, 983, 10.1037/0022-006X.64.5.983 · DOI · Paper page
  11. JJ Froh, 2008, Counting blessings in early adolescents: An experimental study of gratitude and subjective well-being, J Sch Psychol, 46, 213, 10.1016/j.jsp.2007.03.005 · DOI · Paper page
  12. ED Goldstein, 2007, Sacred moments: Implications on well-being and stress, J Clin Psychol, 63, 1001, 10.1002/jclp.20402 · DOI · Paper page
  13. LS Green, 2006, Cognitive-behavioral, solution-focused life coaching: Enhancing goal striving, well-being, and hope, J Posit Psychol, 1, 142, 10.1080/17439760600619849 · DOI · Paper page
  14. S Lichter, 1980, Increasing happiness through cognitive retraining, N Z Psychol, 9, 57
  15. CA Low, 2006, Expressive disclosure and benefit finding among breast cancer patients: Mechanisms for positive health effects, Health Psychol, 25, 181, 10.1037/0278-6133.25.2.181 · DOI · Paper page
  16. AK Macleod, 2008, Increasing well-being through teaching goal-setting and planning skills: results of a brief intervention, J Happiness Stud, 9, 185, 10.1007/s10902-007-9057-2 · DOI · Paper page
  17. GL Reed, 2006, The effects of forgiveness therapy on depression, anxiety, and posttraumatic stress for women after spousal emotional abuse, J Consult Clin Psychol, 74, 920, 10.1037/0022-006X.74.5.920 · DOI · Paper page
  18. KM Sheldon, 2002, Personal goals and psychological growth: Testing an intervention to enhance goal attainment and personality integration, J Pers, 70, 5, 10.1111/1467-6494.00176 · DOI · Paper page
  19. JF Wing, 2006, The effect of positive writing on emotional intelligence and life satisfaction, J Clin Psychol, 62, 1291, 10.1002/jclp.20292 · DOI · Paper page
  20. MEP Seligman, 2006, Positive psychotherapy, Am Psychol, 61, 774, 10.1037/0003-066X.61.8.774 · DOI · Paper page
  21. GB Spence, 2007, Professional and peer life coaching and the enhancement of goal striving and well-being: An exploratory study, J Posit Psychol, 2, 185, 10.1080/17439760701228896 · DOI · Paper page
  22. WP Smith, 1995, Meditation as an adjunct to a happiness enhancement program, J Clin Psychol, 51, 269, 10.1002/1097-4679(199503)51:2<269::AID-JCLP2270510217>3.0.CO;2-0 · doi:10.1002/1097-4679(199503)51:2<269::aid-jclp2270510217>3.0.co;2-0
  23. S Lyubomirsky, 2005, Pursuing happiness: The architecture of sustainable change, Rev Gen Psychol, 9, 111, 10.1037/1089-2680.9.2.111 · DOI · Paper page
  24. M Bédard, 2003, Pilot evaluation of a mindfulness-based intervention to improve quality of life among individuals who sustained traumatic brain injuries, Disabil Rehabil, 25, 722, 10.1080/0963828031000090489 · DOI · Paper page
  25. W-F Lin, 2004, Effects of forgiveness therapy on anger, mood, and vulnerability to substance use among inpatient substance-dependent clients, J Consult Clin Psychol, 72, 1114, 10.1037/0022-006X.72.6.1114 · DOI · Paper page
  26. CM Burton, 2004, The health benefits of writing about intensely positive experiences, J Res Personal, 38, 150, 10.1016/S0092-6566(03)00058-8 · DOI · Paper page
  27. N Frieswijk, 2006, The effectiveness of a bibliotherapy in increasing the self-management ability of slightly to moderately frail older people, Patient Educ Couns, 61, 219, 10.1016/j.pec.2005.03.011 · DOI
  28. AM Grant, 2009, Executive coaching enhances goal attainment, resilience and workplace well-being: A randomised controlled study, J Posit Psychol, 4, 396, 10.1080/17439760902992456 · DOI · Paper page
  29. DB Hurley, 2012, Results of a study to increase savoring the moment: Differential impact on positive and negative outcomes, J Happiness Stud, 13, 579, 10.1007/s10902-011-9280-8 · DOI
  30. IP Kremers, 2006, Improved self-management ability and well-being in older women after a short group intervention, Aging Ment Health, 10, 476, 10.1080/13607860600841206 · DOI · Paper page
  31. K Layous, 2012, What is the optimal way to deliver a positive activity intervention? The case of writing about one’s best possible selves, J Happiness Stud, 14, 635, 10.1007/s10902-012-9346-2 · DOI · Paper page
  32. KM Page, 2012, The working for wellness program: RCT of an employee well-being intervention, J Happiness Stud, 14, 1007, 10.1007/s10902-012-9366-y · DOI
  33. ML Peters, 2010, Manipulating optimism: Can imagining a best possible self be used to increase positive future expectancies?, J Posit Psychol, 5, 204, 10.1080/17439761003790963 · DOI · Paper page
  34. KM Sheldon, 2006, How to increase and sustain positive emotion: The effects of expressing gratitude and visualizing best possible selves, J Posit Psychol, 1, 73, 10.1080/17439760500510676 · DOI · Paper page
  35. JF Wing, 2006, The effect of positive writing on emotional intelligence and life satisfaction, J Clin Psychol, 62, 1291, 10.1002/jclp.20292 · DOI · Paper page
  36. AM Grant, 2012, Making positive change: A randomized study comparing solution-focused vs. problem-focused coaching questions, J Syst Ther, 31, 21, 10.1521/jsyt.2012.31.2.21 · DOI · Paper page
  37. ML Martínez-Martí, 2010, The effects of counting blessings on subjective well-being: A gratitude intervention in a Spanish sample, Span J Psychol, 13, 886, 10.1017/S1138741600002535 · DOI · Paper page
  38. LS Green, 2006, Cognitive-behavioral, solution-focused life coaching: Enhancing goal striving, well-being, and hope, J Posit Psychol, 1, 142, 10.1080/17439760600619849 · DOI · Paper page
  39. J-A Abbott, 2009, The impact of online resilience training for sales managers on wellbeing and performance, E-J Appl Psychol, 5, 89, 10.7790/ejap.v5i1.145 · DOI · Paper page
  40. DB Feldman, 2011, Can hope be changed in 90 minutes? Testing the efficacy of a single-session goal-pursuit intervention for college students, J Happiness Stud, 13, 745, 10.1007/s10902-011-9292-4 · DOI · Paper page
  41. F Luthans, 2010, The development and resulting performance impact of positive psychological capital, Hum Resour Dev Q, 21, 41, 10.1002/hrdq.20034 · DOI · Paper page
  42. SB Morris, 2008, Estimating Effect Sizes From the Pretest-Posttest-Control Group Designs, Organ Res Methods
  43. AD Re, 2012, MAc: Meta-Analysis with Correlations, R package version 1.1.
  44. RA Emmons, 2003, Counting blessings versus burdens: An experimental investigation of gratitude and subjective well-being in daily life, J Pers Soc Psychol, 84, 377, 10.1037/0022-3514.84.2.377 · doi:10.1037/0022-3514.84.2.377 · Paper page
  45. CA Low, 2006, Expressive disclosure and benefit finding among breast cancer patients: Mechanisms for positive health effects, Health Psychol, 25, 181, 10.1037/0278-6133.25.2.181 · DOI · Paper page
  46. CT Tkach, 2005, Unlocking the treasury of human kindness enduring improvements in mood, happiness, and self-evaluations, Unlocking the treasury of human kindness enduring improvements in mood, happiness, and self-evaluations
  47. C Pretorius, 2008, The design and evaluation of a hope enhancement program for adults, J Psychol Afr, 18, 301, 10.1080/14330237.2008.10820202 · DOI
  48. M Mongrain, 2011, Practicing compassion increases happiness and self-esteem, J Happiness Stud, 12, 963, 10.1007/s10902-010-9239-1 · DOI · Paper page
  49. A Liberati, 2009, The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration, PLoS Med, 6, 10.1371/journal.pmed.1000100 · DOI · Paper page
  50. JPT Higgins, 2002, Quantifying heterogeneity in a meta-analysis, Stat Med, 21, 1539, 10.1002/sim.1186 · DOI · Paper page
  51. TD Stanley, 2014, Meta-regression approximations to reduce publication selection bias, Res Synth Methods, 5, 60, 10.1002/jrsm.1095 · DOI · Paper page
  52. G Rücker, 2011, Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis, Biostat Oxf Engl, 12, 122, 10.1093/biostatistics/kxq046 · DOI · Paper page
  53. W. Viechtbauer, 2010, Conducting meta-analyses in R with the metafor Package, J Stat Softw, 36
  54. AJ Howell, 2016, Implicit theories of well-being predict well-being and the endorsement of therapeutic lifestyle changes, J Happiness Stud, 17, 2347, 10.1007/s10902-015-9697-6 · DOI
  55. CA Capaldi, 2015, Flourishing in nature: A review of the benefits of connecting with nature and its application as a wellbeing intervention, Int J Wellbeing, 5, 10.5502/ijw.v5i4.449 · doi:10.5502/ijw.v5i4.449 · Paper page
  56. H-A Passmore, 2016, Noticing nature: Individual and social benefits of a two-week intervention, Noticing nature: Individual and social benefits of a two-week intervention, 0, 1
  57. K Kushlev, 2017, ENHANCE: Design and rationale of a randomized controlled trial for promoting enduring happiness & well-being, Contemp Clin Trials, 52, 62, 10.1016/j.cct.2016.11.003 · DOI

Cited by

Metadata

Authors
White, C. A., Uttl, B., & Holder, M. D.
Venue
PLOS ONE
Published
2019-05-29
Volume
14
Issue
5
Pages
e0216588
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2947762722
Cited by
200
References
62
FWCI
29.93
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.