CoChat

Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial

Open access
Goldberg, Simon B, Imhoff-Smith, Theodore, Bolt, Daniel M, Wilson-Mendenhall, Christine D, Dahl, Cortland J, Davidson, Richard J, Rosenkranz, Melissa A · 2020 · JMIR Mental Health

Published version of a preprint

The DOI matches its Crossref record; 135 of the 135 references it cites were found in a registry or an index; 24 of the 58 sources its claims cite were checked for support.

Abstract

Background: A growing number of randomized controlled trials (RCTs) suggest psychological benefits associated with meditation training delivered via mobile health. However, research in this area has primarily focused on mindfulness, only one of many meditative techniques. Objective: This study aims to evaluate the efficacy of 2 versions of a self-guided, smartphone-based meditation app-the Healthy Minds Program (HMP)-which includes training in mindfulness (Awareness), along with practices designed to cultivate positive relationships (Connection) or insight into the nature of the self (Insight). Methods: A three-arm, fully remote RCT compared 8 weeks of one of 2 HMP conditions (Awareness+Connection and Awareness+Insight) with a waitlist control. Adults (≥18 years) without extensive previous meditation experience were eligible. The primary outcome was psychological distress (depression, anxiety, and stress). Secondary outcomes were social connection, empathy, compassion, self-reflection, insight, rumination, defusion, and mindfulness. Measures were completed at pretest, midtreatment, and posttest between October 2019 and April 2020. Longitudinal data were analyzed using intention-to-treat principles with maximum likelihood. Results: A total of 343 participants were randomized and 186 (54.2%) completed at least one posttest assessment. The majority (166/228, 72.8%) of those assigned to HMP conditions downloaded the app. The 2 HMP conditions did not differ from one another in terms of changes in any outcome. Relative to the waitlist control, the HMP conditions showed larger improvements in distress, social connectedness, mindfulness, and measures theoretically linked to insight training (d=-0.28 to 0.41; Ps≤.02), despite modest exposure to connection- and insight-related practice. The results were robust to some assumptions about nonrandom patterns of missing data. Improvements in distress were associated with days of use. Candidate mediators (social connection, insight, rumination, defusion, and mindfulness) and moderators (baseline rumination, defusion, and empathy) of changes in distress were identified. Conclusions: This study provides initial evidence of efficacy for the HMP app in reducing distress and improving outcomes related to well-being, including social connectedness. Future studies should attempt to increase study retention and user engagement. © Simon B Goldberg, Theodore Imhoff-Smith, Daniel M Bolt, Christine D Wilson-Mendenhall, Cortland J Dahl, Richard J Davidson, Melissa A Rosenkranz. Originally published in JMIR Mental Health (http://mental.jmir.org), 27.11.2020. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.

Overview

CoChat Summary

## TL;DR

This three-arm fully remote RCT found that 8 weeks of the Healthy Minds Program app led to small improvements in psychological distress and several well-being-related outcomes compared with waitlist control, but the two active versions did not differ from each other. The authors conclude the app shows initial efficacy, while emphasizing that attrition and modest engagement limit confidence in the estimates.

## Key findings

  • 343 participants were randomized: 121 to Connection, 107 to Insight, and 115 to waitlist; 186/343 (54.2%) completed at least one follow-up assessment.
  • The two active conditions did not differ from each other on change in any outcome (time×group Ps ≥ .29).
  • Relative to waitlist, the active conditions showed greater improvement in:
  • distress (d = 0.28),
  • rumination (d = 0.18),
  • social connectedness, self-reflection, insight, defusion, and mindfulness (d = 0.13 to 0.41; FDR-adjusted Ps ≤ .02).
  • Secondary analyses found that higher app use (above the median number of days) was associated with larger improvements in distress, insight, defusion, and mindfulness (FDR-adjusted Ps ≤ .03), and five candidate mechanisms showed significant mediation effects with the largest proportion mediated for mindfulness (0.45).

## Methods

  • Design: 8-week, fully remote, three-arm randomized controlled trial comparing two self-guided smartphone meditation interventions (Awareness+Connection and Awareness+Insight) with a waitlist control.
  • Sample/data: Adults ≥18 years with a smartphone and without extensive prior meditation experience; recruitment via University of Wisconsin-Madison email lists and a Center for Healthy Minds database. Baseline, midtreatment, and posttest surveys were collected online between October 2019 and April 2020.
  • Analysis: Intention-to-treat multilevel models with maximum likelihood estimation; primary contrast was active conditions vs waitlist, with additional analyses for app use, mediation, and baseline moderation. False discovery rate adjustment was applied.

## Limitations

  • The paper explicitly states that high and differential attrition and relatively modest engagement are limitations; the authors note these likely diminished apparent effects.
  • The paper notes no follow-up assessment, so it is unclear whether benefits were sustained.
  • The paper says the study had no active control condition, so digital placebo effects cannot be ruled out.
  • Evident from the text: the sample was predominantly White (81.6%), female (84.5%), and graduate educated (55.4%), which the authors say raises concerns about generalizability, especially to racial/ethnic minorities and people with lower education.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/23825

Cites

135 of 135 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 CONSORT (Consolidated Standards of Reporting Trials) diagram. Mid=week 4 assessment; Post=week 8 assessment.
Figure 1 CONSORT (Consolidated Standards of Reporting Trials) diagram. Mid=week 4 assessment; Post=week 8 assessment.CC BY · PubMed Central
Figure 2 Longitudinal changes in psychological distress, social connectedness, defusion, and mindfulness by group. The figure displays observed means and SEs (error bars=1 SE) based on all available data (n=343). CO: Awareness+Connection; IN: Awareness+Insight; WL: waitlist.
Figure 2 Longitudinal changes in psychological distress, social connectedness, defusion, and mindfulness by group. The figure displays observed means and SEs (error bars=1 SE) based on all available data (n=343). CO: Awareness+Connection; IN: Awareness+Insight; WL: waitlist.CC BY · PubMed Central
Figure 3 Healthy Minds Program app usage predicting longitudinal changes in psychological distress, defusion, insight, and mindfulness in active conditions (FDR-corrected Ps≤.04). Usage=median split of days of use (n=228). HMP: Healthy Minds Program; WL: waitlist.
Figure 3 Healthy Minds Program app usage predicting longitudinal changes in psychological distress, defusion, insight, and mindfulness in active conditions (FDR-corrected Ps≤.04). Usage=median split of days of use (n=228). HMP: Healthy Minds Program; WL: waitlist.CC BY · PubMed Central

Verification

Claims the paper makes

14 Valid · 0 Not valid · 15 Not checked · 71 Own results and interpretations

38 more claims

Create a free account to see all 100 claims and to verify the 3 references still open.

See all claims — free account
  • Probably not a substantial claim. 35
  • It may state two separate claims as one. 31
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 135 references

Research works printed but not linked: 7

  1. Clarke, TC, 2018, NCHS Data Brief, 1
  2. Goldberg, S, 2021, Perspect Psychol Sci, -
  3. Kabat-Zinn, J, 2013, Full Catastrophe Living: How to Cope With Stress, Pain and Illness Using Mindfulness Meditation. Revised Edition
  4. Goldstein, J, 2013, Mindfulness: a Practical Guide to Awakening
  5. Salzberg, S, 2004, Lovingkindness: the Revolutionary Art of Happiness
  6. Cohen, S, 1988, The Social Psychology of Health: Claremont Symposium on Applied Social Psychology
  7. Snijders, T, 2012, Multilevel Analysis: an Introduction to Basic and Advance Multilevel Modeling. Second Edition

Cited by

See all 100

Metadata

Authors
Goldberg, S. B., Imhoff-Smith, T., Bolt, D. M., Wilson-Mendenhall, C. D., Dahl, C. J., Davidson, R. J., & Rosenkranz, M. A.
Affiliations
University of Wisconsin–Madison (US)
Corresponding author
Goldberg, Simon B
Venue
JMIR Mental Health
Published
2020-11-27
Volume
7
Issue
11
Pages
e23825
ISSN
2368-7959 (ISSN-L)
OpenAlex
W3107022472
Cited by
97
References
126
Citations by year
2026: 18 · 2025: 24 · 2024: 13 · 2023: 18 · 2022: 13 · 2021: 10 · 2020: 1
FWCI
4.20
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Institutes of Health (UL1TR002373)
  • National Center for Advancing Translational Sciences
  • National Center for Complementary and Integrative Health (K23AT010879)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
meditation apps, mobile health, mindfulness, psychological distress, depression, anxiety, stress, social connectedness, empathy, compassion, self-reflection, rumination, defusion, app engagement, user retention, meditation training, well-being, mediating and moderating effects, remote intervention, mobile application, insight

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.