Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial
Open accessPublished version of a preprint
The DOI matches its Crossref record; 135 of the 135 references it cites were found in a registry or an index; 24 of the 58 sources its claims cite were checked for support.
Abstract
Background: A growing number of randomized controlled trials (RCTs) suggest psychological benefits associated with meditation training delivered via mobile health. However, research in this area has primarily focused on mindfulness, only one of many meditative techniques. Objective: This study aims to evaluate the efficacy of 2 versions of a self-guided, smartphone-based meditation app-the Healthy Minds Program (HMP)-which includes training in mindfulness (Awareness), along with practices designed to cultivate positive relationships (Connection) or insight into the nature of the self (Insight). Methods: A three-arm, fully remote RCT compared 8 weeks of one of 2 HMP conditions (Awareness+Connection and Awareness+Insight) with a waitlist control. Adults (≥18 years) without extensive previous meditation experience were eligible. The primary outcome was psychological distress (depression, anxiety, and stress). Secondary outcomes were social connection, empathy, compassion, self-reflection, insight, rumination, defusion, and mindfulness. Measures were completed at pretest, midtreatment, and posttest between October 2019 and April 2020. Longitudinal data were analyzed using intention-to-treat principles with maximum likelihood. Results: A total of 343 participants were randomized and 186 (54.2%) completed at least one posttest assessment. The majority (166/228, 72.8%) of those assigned to HMP conditions downloaded the app. The 2 HMP conditions did not differ from one another in terms of changes in any outcome. Relative to the waitlist control, the HMP conditions showed larger improvements in distress, social connectedness, mindfulness, and measures theoretically linked to insight training (d=-0.28 to 0.41; Ps≤.02), despite modest exposure to connection- and insight-related practice. The results were robust to some assumptions about nonrandom patterns of missing data. Improvements in distress were associated with days of use. Candidate mediators (social connection, insight, rumination, defusion, and mindfulness) and moderators (baseline rumination, defusion, and empathy) of changes in distress were identified. Conclusions: This study provides initial evidence of efficacy for the HMP app in reducing distress and improving outcomes related to well-being, including social connectedness. Future studies should attempt to increase study retention and user engagement. © Simon B Goldberg, Theodore Imhoff-Smith, Daniel M Bolt, Christine D Wilson-Mendenhall, Cortland J Dahl, Richard J Davidson, Melissa A Rosenkranz. Originally published in JMIR Mental Health (http://mental.jmir.org), 27.11.2020. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.
Overview
CoChat Summary
## TL;DR
This three-arm fully remote RCT found that 8 weeks of the Healthy Minds Program app led to small improvements in psychological distress and several well-being-related outcomes compared with waitlist control, but the two active versions did not differ from each other. The authors conclude the app shows initial efficacy, while emphasizing that attrition and modest engagement limit confidence in the estimates.
## Key findings
- 343 participants were randomized: 121 to Connection, 107 to Insight, and 115 to waitlist; 186/343 (54.2%) completed at least one follow-up assessment.
- The two active conditions did not differ from each other on change in any outcome (time×group Ps ≥ .29).
- Relative to waitlist, the active conditions showed greater improvement in:
- distress (d = 0.28),
- rumination (d = 0.18),
- social connectedness, self-reflection, insight, defusion, and mindfulness (d = 0.13 to 0.41; FDR-adjusted Ps ≤ .02).
- Secondary analyses found that higher app use (above the median number of days) was associated with larger improvements in distress, insight, defusion, and mindfulness (FDR-adjusted Ps ≤ .03), and five candidate mechanisms showed significant mediation effects with the largest proportion mediated for mindfulness (0.45).
## Methods
- Design: 8-week, fully remote, three-arm randomized controlled trial comparing two self-guided smartphone meditation interventions (Awareness+Connection and Awareness+Insight) with a waitlist control.
- Sample/data: Adults ≥18 years with a smartphone and without extensive prior meditation experience; recruitment via University of Wisconsin-Madison email lists and a Center for Healthy Minds database. Baseline, midtreatment, and posttest surveys were collected online between October 2019 and April 2020.
- Analysis: Intention-to-treat multilevel models with maximum likelihood estimation; primary contrast was active conditions vs waitlist, with additional analyses for app use, mediation, and baseline moderation. False discovery rate adjustment was applied.
## Limitations
- The paper explicitly states that high and differential attrition and relatively modest engagement are limitations; the authors note these likely diminished apparent effects.
- The paper notes no follow-up assessment, so it is unclear whether benefits were sustained.
- The paper says the study had no active control condition, so digital placebo effects cannot be ruled out.
- Evident from the text: the sample was predominantly White (81.6%), female (84.5%), and graduate educated (55.4%), which the authors say raises concerns about generalizability, especially to racial/ethnic minorities and people with lower education.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
14 Valid · 0 Not valid · 15 Not checked · 71 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Smartphone-based meditation interventions have almost exclusively focused on mindfulness training [30,62], although several studies have investigated internet-based interventions that include connection-related practices [63-65].”
§ Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [30] source
- Partly supportedcites [62] sourceExperimental — accuracy not yet measured
The Results (Features of High-Quality Mindfulness Apps; page unavailable) describe mindfulness-training apps that include guided meditation, supporting the existence of smartphone-based meditation interventions focused on mindfulness. But the review selected mindfulness apps and did not assess smartphone meditation interventions generally, so it cannot establish that they have almost exclusively focused on mindfulness training. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“RCTs primarily examining constructive or deconstructive practices are rare (with some promising exceptions) [66,67].”
§ Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial > Introduction > Background
What the sources say
- Partly supportedcites [66] sourceExperimental — accuracy not yet measured
The Methods (Trial Design; page unavailable) describe this paper as an RCT that includes self-compassion training, so it supports the citation as a promising exception. The Discussion (Principal Findings—Efficacy and Application; page unavailable) calls rigorous RCTs of mobile mindfulness and self-compassion apps few, but does not establish that RCTs of constructive or deconstructive practices generally are rare. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [67] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although preliminary, available evidence suggests that smartphone-based interventions that include training in meditation and mindfulness may provide psychological benefits that are similar to in-person MBIs (eg, decreased psychological symptoms, increased positive functioning), albeit smaller in magnitude [30,39-42].”
§ Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [30] source
- Partly supportedcites [39] sourceExperimental — accuracy not yet measured
Section 3.5 reports that some smartphone interventions reduced anxiety, supporting the general claim of psychological benefit. But the interventions described there use CBT, self-monitoring, and positive psychology; our copy does not establish benefits from meditation or mindfulness training, or compare their magnitude with in-person mindfulness-based interventions. Section 4 says that a direct comparison of smartphone-only and face-to-face anxiety therapies had not been examined. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites [40] source
- Partly supportedcites [41] sourceExperimental — accuracy not yet measured
The Abstract reports improvements in psychological symptoms and positive affect from smartphone interventions, and the Discussion says the analysis included apps with mindfulness or acceptance-based components. It also reports no significant difference from active interventions, but those comparisons were not specific to in-person mindfulness-based interventions. The paper does not establish that mindfulness apps have smaller benefits than in-person MBIs. (LLM, conf=0.86)
- Partly supportedcites [42] sourceExperimental — accuracy not yet measured
The abstract reports benefits of online MBIs for depression, anxiety, well-being and mindfulness. Section 4.1 says their effects on depression and anxiety were generally smaller than those reported for face-to-face MBIs, while cautioning that a firm comparison is premature. Section 3.2.2 shows that only one included comparison used a smartphone app, so the paper does not establish these findings specifically for smartphone-based interventions. (LLM, conf=0.88)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Barriers for the dissemination of MBIs are similar to those facing other evidence-based psychotherapies (eg, lack of available providers, cost, logistical challenges) [23-25].”
§ Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial > Introduction > Background
What the sources say
- Partly supportedcites [23] sourceExperimental — accuracy not yet measured
The Results (Barriers to seeking treatment; page unavailable) identify financial barriers and lack of availability, while the Introduction describes inconvenient locations and difficulty obtaining appointments. The paper studies mental health treatment broadly; it does not establish that these barriers are similar for MBIs and other evidence-based psychotherapies. (LLM, conf=0.86)
- Partly supportedcites [24] sourceExperimental — accuracy not yet measured
The Abstract identifies inadequate training and unsupportive organizational climates as barriers to disseminating evidence-based psychotherapies, and the General Discussion describes difficulty achieving therapist proficiency. The paper does not establish that barriers to mindfulness-based interventions (MBIs) are similar, or identify cost and logistical challenges as the cited examples do. It supports the general point that other evidence-based psychotherapies face dissemination barriers, but not the full comparison. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [25] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“These effects are considerably smaller than those produced by in-person MBIs (eg, d=0.55 vs waitlist) [9].”
§ Testing the Efficacy of a Multicomponent, Self-Guided, Smartphone-Based Meditation App: Three-Armed Randomized Controlled Trial > Discussion > Principal Findings
What the sources say
- Supportedcites [9] source
The Results (Synthesis of Results; page not supplied) report d = 0.55 for mindfulness-based interventions versus no-treatment controls at post-treatment. The Discussion describes waitlist controls as a form of no-treatment comparison, and the Methods (Eligibility Criteria; page not supplied) exclude interventions delivered exclusively by video or smartphone app. The comparison with “these effects” is the citing authors’ own framing, not a finding attributed to this source. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
38 more claims
Create a free account to see all 100 claims and to verify the 3 references still open.
- Probably not a substantial claim. 35
- It may state two separate claims as one. 31
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work has identified some baseline patient characteristics that predict MBI treatment response.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [130]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Available evidence from randomized controlled trials does not indicate that smartphone-based meditation interventions increase risk for harm but may, like in-person meditation training, actually reduce the risk of certain types of harm (e.g., target symptom worsening) relative to a waitlist control (Goldberg et al., 2020).”
From Prevalence of meditation-related adverse effects in a population-based sample in the United States (2022) · cites this paper as Goldberg et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant effects of these apps on mindfulness, well-being and perceived stress were found in the general population26,27, in healthy employees28 and categories prone to burnout, i.e., physicians29, or with high levels of stress, i.e., college students30, in particular, medical students31 and pharmacy students32.”
From Mindfulness-based online intervention increases well-being and decreases stress after Covid-19 lockdown (2022) · cites this paper as [26]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“identifying as a woman and being low on extraversion are associated with larger improvement in psychological distress following mindfulness-based cognitive therapy for distressed individuals with diabetes130”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [130]
Experimental — accuracy not yet measured
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“To assess baseline characteristics as moderators of change in distress, we tested 3-way interactions between time, group, and baseline characteristics within MLMs. False discovery rate (FDR) adjustment [85] was applied to all analyses to control for inflation of a type I error.”
MethodBaron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
The REDCap consortium: building an international community of software platform partners
Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O'Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., et al. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103208 · Cited by 24,013 · cited 1×
“All screening procedures and data collection were web-based and carried out using REDCap [69].”
MethodSubjective well-being: Three decades of progress.
Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.2.276 · Cited by 12,910
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Measuring individual differences in empathy: Evidence for a multidimensional approach.
Davis, M. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.113 · Cited by 10,272 · cited 1×
“The 28-item Interpersonal Reactivity Index (IRI) [76] assessed empathy.”
BackgroundUsing Self-Report Assessment Methods to Explore Facets of Mindfulness
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006) · Assessment · doi:10.1177/1073191105283504 · Cited by 7,511 · cited 1×
“The 39-item Five Facet Mindfulness Questionnaire [81] assessed mindfulness.”
Method(2010) · Cited by 7,034
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 3×
“MLMs with a maximum likelihood estimator are generally robust to data that are missing at random (MAR) [83].”
BackgroundMethodInfluential
Research works printed but not linked: 7
- Clarke, TC, 2018, NCHS Data Brief, 1
- Goldberg, S, 2021, Perspect Psychol Sci, -
- Kabat-Zinn, J, 2013, Full Catastrophe Living: How to Cope With Stress, Pain and Illness Using Mindfulness Meditation. Revised Edition
- Goldstein, J, 2013, Mindfulness: a Practical Guide to Awakening
- Salzberg, S, 2004, Lovingkindness: the Revolutionary Art of Happiness
- Cohen, S, 1988, The Social Psychology of Health: Claremont Symposium on Applied Social Psychology
- Snijders, T, 2012, Multilevel Analysis: an Introduction to Basic and Advance Multilevel Modeling. Second Edition
Cited by
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
Torous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
Self-citationThe plasticity of well-being: A training-based framework for the cultivation of human flourishing
Dahl, C. J., Wilson-Mendenhall, C. D., & Davidson, R. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014859117 · Cited by 253
Self-citationPrevalence of meditation-related adverse effects in a population-based sample in the United States
Goldberg, S. B., Lam, S. U., Britton, W. B., & Davidson, R. J. (2022) · Psychotherapy Research · doi:10.1080/10503307.2021.1933646 · Cited by 115
Self-citationAlliance with an unguided smartphone app: validation of the digital working alliance inventory
Goldberg, S. B., Baldwin, S. A., Riordan, K. M., Torous, J., Dahl, C. J., Davidson, R. J., & Hirshberg, M. J. (2022) · Assessment · doi:10.1177/10731911211015310 · Cited by 74
Self-citation
Metadata
- Authors
- Goldberg, S. B., Imhoff-Smith, T., Bolt, D. M., Wilson-Mendenhall, C. D., Dahl, C. J., Davidson, R. J., & Rosenkranz, M. A.
- Affiliations
- University of Wisconsin–Madison (US)
- Corresponding author
- Goldberg, Simon B
- ORCID
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-27
- Volume
- 7
- Issue
- 11
- Pages
- e23825
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7732708
- OpenAlex
- W3107022472
- Cited by
- 97
- References
- 126
- Citations by year
- 2026: 18 · 2025: 24 · 2024: 13 · 2023: 18 · 2022: 13 · 2021: 10 · 2020: 1
- FWCI
- 4.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (UL1TR002373)
- National Center for Advancing Translational Sciences
- National Center for Complementary and Integrative Health (K23AT010879)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- meditation apps, mobile health, mindfulness, psychological distress, depression, anxiety, stress, social connectedness, empathy, compassion, self-reflection, rumination, defusion, app engagement, user retention, meditation training, well-being, mediating and moderating effects, remote intervention, mobile application, insight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.