Synthesizing positive psychological interventions: Suggestions for conducting and interpreting meta-analyses
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Systematic reviews, such as meta-analyses, are highly valued within scientific, professional, and lay communities because they provide an easily digestible aggregate of a large body of work.A recently published meta-analysis of positive psychology interventions concluded that these interventions have small effects and argued for the use of these interventions in diverse populations (Bolier et al., 2013).We caution researchers against drawing conclusions from this study because of the unusual definition of what is (and is not) a positive psychological intervention.Bolier and colleagues (2013) define their area of inquiry as "pure positive psychology interventions" and limit their sample to studies conducted within the years following the formal founding of the positive psychology movement.This decision -while well intentioned, as it provides specificity to their criteria for inclusion -is, in our view, too narrow, excluding a host of studies that use the same intervention strategies and target the same outcomes but do not explicitly reference "positive psychology".The inclusion criteria of a systematic review directly impact its findings and conclusions.Using the criterion of papers that explicitly reference positive psychology creates an arbitrary boundary that reflects neither the research nor practice of the field; the best practitioners prioritize effectiveness and efficiency over explicit ties to "positive psychology".Arbitrary boundaries hinder science and impair the ability of researchers, clinicians, and the general public to draw accurate conclusions from the findings.It also limits the metaanalyst's ability to conduct moderation analysis that can help drive the field forward by answering research questions that are difficult to address in a single study.Positive psychology and psychology more generally would benefit from definitions of terms that are conceptually-based and thus meta-analyses that are theoretically sound.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subjective well-being. The science of happiness and a proposal for a national index
Diener, E. (2000) · American Psychologist · doi:10.1037/0003-066x.55.1.34 · Cited by 7,121 · cited 1×
“In this perspective, wellbeing is a sum of positive evaluations of one’s life (cognitive) and frequent experiences of positive emotions and infrequent experiences of negative emotions (affective) (Diener, 2000).”
Sin, N. L., & Lyubomirsky, S. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20593 · Cited by 2,955 · cited 6×
“This difference was even more pronounced for depressive symptoms (d = .23 for Bolier et al., 2013; r = .31 for Sin & Lyubomirsky, 2009, which corresponds to d = .65).”
BackgroundResultInfluentialPositive psychology interventions: a meta-analysis of randomized controlled studies
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-119 · Cited by 1,996 · cited 7×
“This difference was even more pronounced for depressive symptoms (d = .23 for Bolier et al., 2013; r = .31 for Sin & Lyubomirsky, 2009, which corresponds to d = .65).”
BackgroundInfluentialSeligman, M. E. P., Rashid, T., & Parks, A. C. (2006) · American Psychologist · doi:10.1037/0003-066x.61.8.774 · Cited by 1,560
Self-citationThe Psychology of Change: Self-Affirmation and Social Psychological Intervention
Cohen, G. L., & Sherman, D. K. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115137 · Cited by 1,302 · cited 1×
“As an example, consider the research on values affirmations (Cohen & Sherman, 2014).”
How Do Simple Positive Activities Increase Well-Being?
Lyubomirsky, S., & Layous, K. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412469809 · Cited by 1,197
Positive Psychology in Clinical Practice
Lee Duckworth, A., Steen, T. A., & Seligman, M. E. P. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.144154 · Cited by 1,095
Reconsidering happiness: The costs of distinguishing between hedonics and eudaimonia
Kashdan, T. B., Biswas-Diener, R., & King, L. A. (2008) · The Journal of Positive Psychology · doi:10.1080/17439760802303044 · Cited by 1,027
Self-citationLyubomirsky, S. (2001) · American Psychologist · doi:10.1037/0003-066x.56.3.239 · Cited by 995
Sheldon, K. M., & Lyubomirsky, S. (2006) · The Journal of Positive Psychology · doi:10.1080/17439760500510676 · Cited by 925 · cited 2×
“…of this intervention in their meta-analysis (Boehm et al., 2011; King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.g., Austenfeld et al., 2006; Austenfeld & Stanton, 2008; Hanssen et al., 2013; King & Miner, 2000;…”
BackgroundPossible selves and academic outcomes: How and when possible selves impel action.
Oyserman, D., Bybee, D., & Terry, K. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.1.188 · Cited by 852 · cited 2×
“…King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.g., Austenfeld et al., 2006; Austenfeld & Stanton, 2008; Hanssen et al., 2013; King & Miner, 2000; Meevissen et al. 2011; Oyserman et al., 2006; Peters et al., 2013).”
BackgroundThe Health Benefits of Writing about Life Goals
King, L. A. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201277003 · Cited by 795 · cited 2×
“Indeed, Bolier and colleagues (2013) included several studies of this intervention in their meta-analysis (Boehm et al., 2011; King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.g., Austenfeld et al., 2006; Austenfeld &…”
BackgroundLyubomirsky, S., Dickerhoof, R., Boehm, J. K., & Sheldon, K. M. (2011) · Emotion · doi:10.1037/a0022575 · Cited by 720
Self-affirmation and self-control: Affirming core values counteracts ego depletion.
Schmeichel, B. J., & Vohs, K. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0014635 · Cited by 602
Affirmation of personal values buffers neuroendocrine and psychological stress responses
Creswell, J. D., Welch, W. T., Taylor, S. E., Sherman, D. K., Gruenewald, T. L., & Mann, T. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01624.x · Cited by 482 · cited 1×
“In laboratory intervention studies, researchers ask people to reflect on the self-defined, abstract, life principles that serve to guide personal goals and the dedication of effort to what is most meaningful and important to them (Cook, Purdie-Vaughns, Garcia, & Cohen, 2012; Creswell et al., 2005).”
BackgroundCombating stereotype threat: The effect of self‐affirmation on women's intellectual performance
Martens, A., Johns, M., Greenberg, J., & Schimel, J. (2006) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2005.04.010 · Cited by 460
Development of a program to increase personal happiness.
Fordyce, M. W. (1977) · Journal of Counseling Psychology · doi:10.1037/0022-0167.24.6.511 · Cited by 411
Become more optimistic by imagining a best possible self: Effects of a two week intervention
Meevissen, Y. M. C., Peters, M. L., & Alberts, H. J. E. M. (2011) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2011.02.012 · Cited by 335
Writing about the Perceived Benefits of Traumatic Events: Implications for Physical Health
King, L. A., & Miner, K. N. (2000) · Personality and Social Psychology Bulletin · doi:10.1177/0146167200264008 · Cited by 321
Boehm, J. K., Lyubomirsky, S., & Sheldon, K. M. (2011) · Cognition and Emotion · doi:10.1080/02699931.2010.541227 · Cited by 318 · cited 2×
“Indeed, Bolier and colleagues (2013) included several studies of this intervention in their meta-analysis (Boehm et al., 2011; King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.”
BackgroundDisseminating Self-Help: Positive Psychology Exercises in an Online Trial
Schueller, S. M., & Parks, A. C. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1850 · Cited by 246 · cited 1×
“…new, unique populations (Froh, Kashdan, Ozimkowski, & Miller, 2009; Meyer, Johnson, Parks, Iwanski, & Penn, 2012), new settings (Huppert & Johnson, 2010; Reivich, Seligman, & McBride, 2011; Seligman, Rashid, & Parks, 2006), and new modes of delivery (Parks & Szanto, 2013; Schueller & Parks, 2012).”
Self-citationCook, J. E., Purdie-Vaughns, V., Garcia, J., & Cohen, G. L. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0026312 · Cited by 244
Feasibility and utility of positive psychology exercises for suicidal inpatients
Huffman, J. C., DuBois, C. M., Healy, B. C., Boehm, J. K., Kashdan, T. B., Celano, C. M., Denninger, J. W., & Lyubomirsky, S. (2014) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.10.006 · Cited by 209 · cited 2×
“…clinical populations, such as people with schizophrenia (Meyer et al., 2012), smokers who wish to stop smoking (Kahler et al., 2014), and suicidal inpatients (Huffman et al., 2013), but with the focus being on building the positive aspects in these individuals as opposed to reducing the negative.”
BackgroundSelf-citationOptimism lowers pain: Evidence of the causal status and underlying mechanisms
Hanssen, M. M., Peters, M. L., Vlaeyen, J. W. S., Meevissen, Y. M. C., & Vancleef, L. M. G. (2013) · Pain · doi:10.1016/j.pain.2012.08.006 · Cited by 202 · cited 2×
“…King, 2001; Layous et al., 2013; Lyubomirsky et al., 2011; Peters et al., 2010; Sheldon & Lyubomirsky, 2006) but omitted others (e.g., Austenfeld et al., 2006; Austenfeld & Stanton, 2008; Hanssen et al., 2013; King & Miner, 2000; Meevissen et al. 2011; Oyserman et al., 2006; Peters et al., 2013).”
BackgroundAssessing the efficacy and effectiveness of a Positive Psychology-based self-help book
Parks, A. C., & Szanto, R. K. (2013) · Terapia psicológica · doi:10.4067/s0718-48082013000100013 · Cited by 35 · cited 1×
“…new, unique populations (Froh, Kashdan, Ozimkowski, & Miller, 2009; Meyer, Johnson, Parks, Iwanski, & Penn, 2012), new settings (Huppert & Johnson, 2010; Reivich, Seligman, & McBride, 2011; Seligman, Rashid, & Parks, 2006), and new modes of delivery (Parks & Szanto, 2013; Schueller & Parks, 2012).”
Self-citation
Cited by
Effectiveness of positive psychology interventions: a systematic review and meta-analysis
Carr, A., Cullen, K., Keeney, C., Canning, C., Mooney, O., Chinseallaigh, E., & O’Dowd, A. (2021) · The Journal of Positive Psychology · doi:10.1080/17439760.2020.1818807 · Cited by 645
“In contrast, a broad inclusive definition views PPIs as evidence-based interventions which have the primary aim of increasing wellbeing (not just reducing symptoms), that have been developed within any field of psychology, before or since the founding of positive psychology (Schueller et al., 2014).”
BackgroundInfluentialPositive interventions: An emotion regulation perspective.
Quoidbach, J., Mikolajczak, M., & Gross, J. J. (2015) · Psychological Bulletin · doi:10.1037/a0038648 · Cited by 546
A systematic review and meta-analysis of psychological interventions to improve mental wellbeing
van Agteren, J., Iasiello, M., Lo, L., Bartholomaeus, J., Kopsaftis, Z., Carey, M., & Kyrios, M. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01093-w · Cited by 510
Hendriks, T., Warren, M. A., Schotanus-Dijkstra, M., Hassankhan, A., Graafsma, T., Bohlmeijer, E., & de Jong, J. (2019) · The Journal of Positive Psychology · doi:10.1080/17439760.2018.1484941 · Cited by 280
Koydemir, S., Sökmez, A. B., & Schütz, A. (2021) · Applied Research in Quality of Life · doi:10.1007/s11482-019-09788-z · Cited by 190
Metadata
- Authors
- Schueller, S. M., Kashdan, T. B., & Parks, A. C.
- Venue
- International Journal of Wellbeing
- Publisher
- International Journal of Wellbeing
- Published
- 2014-06-04
- Volume
- 4
- Issue
- 1
- Pages
- 91-98
- ISSN
- 1179-8602 (ISSN-L)
- OpenAlex
- W2068395126
- Cited by
- 94
- References
- 25
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.