Synthesizing positive psychological interventions: Suggestions for conducting and interpreting meta-analyses
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Systematic reviews, such as meta-analyses, are highly valued within scientific, professional, and lay communities because they provide an easily digestible aggregate of a large body of work.A recently published meta-analysis of positive psychology interventions concluded that these interventions have small effects and argued for the use of these interventions in diverse populations (Bolier et al., 2013).We caution researchers against drawing conclusions from this study because of the unusual definition of what is (and is not) a positive psychological intervention.Bolier and colleagues (2013) define their area of inquiry as "pure positive psychology interventions" and limit their sample to studies conducted within the years following the formal founding of the positive psychology movement.This decision -while well intentioned, as it provides specificity to their criteria for inclusion -is, in our view, too narrow, excluding a host of studies that use the same intervention strategies and target the same outcomes but do not explicitly reference "positive psychology".The inclusion criteria of a systematic review directly impact its findings and conclusions.Using the criterion of papers that explicitly reference positive psychology creates an arbitrary boundary that reflects neither the research nor practice of the field; the best practitioners prioritize effectiveness and efficiency over explicit ties to "positive psychology".Arbitrary boundaries hinder science and impair the ability of researchers, clinicians, and the general public to draw accurate conclusions from the findings.It also limits the metaanalyst's ability to conduct moderation analysis that can help drive the field forward by answering research questions that are difficult to address in a single study.Positive psychology and psychology more generally would benefit from definitions of terms that are conceptually-based and thus meta-analyses that are theoretically sound.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subjective well-being. The science of happiness and a proposal for a national index
Diener, E. (2000) · American Psychologist · doi:10.1037/0003-066x.55.1.34 · Cited by 7,121 · cited 1×
“In this perspective, wellbeing is a sum of positive evaluations of one’s life (cognitive) and frequent experiences of positive emotions and infrequent experiences of negative emotions (affective) (Diener, 2000).”
Sin, N. L., & Lyubomirsky, S. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20593 · Cited by 2,955 · cited 6×
“This difference was even more pronounced for depressive symptoms (d = .23 for Bolier et al., 2013; r = .31 for Sin & Lyubomirsky, 2009, which corresponds to d = .65).”
BackgroundResultInfluentialPositive psychology interventions: a meta-analysis of randomized controlled studies
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-119 · Cited by 1,996 · cited 7×
“This difference was even more pronounced for depressive symptoms (d = .23 for Bolier et al., 2013; r = .31 for Sin & Lyubomirsky, 2009, which corresponds to d = .65).”
BackgroundInfluentialSeligman, M. E. P., Rashid, T., & Parks, A. C. (2006) · American Psychologist · doi:10.1037/0003-066x.61.8.774 · Cited by 1,560
Self-citationThe Psychology of Change: Self-Affirmation and Social Psychological Intervention
Cohen, G. L., & Sherman, D. K. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115137 · Cited by 1,302 · cited 1×
“As an example, consider the research on values affirmations (Cohen & Sherman, 2014).”
How Do Simple Positive Activities Increase Well-Being?
Lyubomirsky, S., & Layous, K. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412469809 · Cited by 1,197
Positive Psychology in Clinical Practice
Lee Duckworth, A., Steen, T. A., & Seligman, M. E. P. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.144154 · Cited by 1,095
Reconsidering happiness: The costs of distinguishing between hedonics and eudaimonia
Kashdan, T. B., Biswas-Diener, R., & King, L. A. (2008) · The Journal of Positive Psychology · doi:10.1080/17439760802303044 · Cited by 1,027
Self-citationLyubomirsky, S. (2001) · American Psychologist · doi:10.1037/0003-066x.56.3.239 · Cited by 995
Sheldon, K. M., & Lyubomirsky, S. (2006) · The Journal of Positive Psychology · doi:10.1080/17439760500510676 · Cited by 925 · cited 2×
“…of this intervention in their meta-analysis (Boehm et al., 2011; King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.g., Austenfeld et al., 2006; Austenfeld & Stanton, 2008; Hanssen et al., 2013; King & Miner, 2000;…”
Background
Cited by
Effectiveness of positive psychology interventions: a systematic review and meta-analysis
Carr, A., Cullen, K., Keeney, C., Canning, C., Mooney, O., Chinseallaigh, E., & O’Dowd, A. (2021) · The Journal of Positive Psychology · doi:10.1080/17439760.2020.1818807 · Cited by 645
“In contrast, a broad inclusive definition views PPIs as evidence-based interventions which have the primary aim of increasing wellbeing (not just reducing symptoms), that have been developed within any field of psychology, before or since the founding of positive psychology (Schueller et al., 2014).”
BackgroundInfluentialPositive interventions: An emotion regulation perspective.
Quoidbach, J., Mikolajczak, M., & Gross, J. J. (2015) · Psychological Bulletin · doi:10.1037/a0038648 · Cited by 546
A systematic review and meta-analysis of psychological interventions to improve mental wellbeing
van Agteren, J., Iasiello, M., Lo, L., Bartholomaeus, J., Kopsaftis, Z., Carey, M., & Kyrios, M. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01093-w · Cited by 510
Hendriks, T., Warren, M. A., Schotanus-Dijkstra, M., Hassankhan, A., Graafsma, T., Bohlmeijer, E., & de Jong, J. (2019) · The Journal of Positive Psychology · doi:10.1080/17439760.2018.1484941 · Cited by 280
Koydemir, S., Sökmez, A. B., & Schütz, A. (2021) · Applied Research in Quality of Life · doi:10.1007/s11482-019-09788-z · Cited by 190
Hone, L. C., Jarden, A., & Schofield, G. M. (2015) · The Journal of Positive Psychology · doi:10.1080/17439760.2014.965267 · Cited by 105
“There is no common definition of a PPI, nor a single, empirically based theoretical framework unifying PPIs (Parks & Biswas-Diener, 2013; Schueller et al., 2014).”
BackgroundHowell, A. J., & Passmore, H.-A. (2019) · Journal of Happiness Studies · doi:10.1007/s10902-018-0027-7 · Cited by 83
Yarosh, S., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6822 · Cited by 49
“Second, this “removing negative” experiences pathway to happiness is inconsistent with most conceptual thinking in positive psychology about what is unique about positive psychological interventions compared with other clinical approaches [66-68].”
Self-citationThe Curious Neglect of High Functioning After Psychopathology: The Case of Depression
Rottenberg, J., Devendorf, A. R., Kashdan, T. B., & Disabato, D. J. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618769868 · Cited by 40
Self-citationLooking at the bowl of fruit or focussing on the apples? Reply to the comments of Schueller et al.
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2014) · International Journal of Wellbeing · doi:10.5502/ijw.v4i1.6 · Cited by 1
“This methodological criterion, the inclusion of only randomized controlled trials, also partly explained why 'only' 19 studies in 17 articles (not 16 studies as Schueller et al., 2014 have stated) overlapped in the Sin and Lybomirsky meta-analysis and our meta-analysis.”
BackgroundInfluential
Metadata
- Authors
- Schueller, S. M., Kashdan, T. B., & Parks, A. C.
- Venue
- International Journal of Wellbeing
- Publisher
- International Journal of Wellbeing
- Published
- 2014-06-04
- Volume
- 4
- Issue
- 1
- Pages
- 91-98
- ISSN
- 1179-8602 (ISSN-L)
- OpenAlex
- W2068395126
- Cited by
- 94
- References
- 25
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.