CoChat

Testing the Pragmatic Effectiveness of a Consumer-Based Mindfulness Mobile App in the Workplace: Randomized Controlled Trial

Open access
Huberty, Jennifer L, Espel-Huynh, Hallie M, Neher, Taylor L, Puzia, Megan E · 2022 · JMIR mHealth and uHealth

The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.

Abstract

Background: Mental health and sleep problems are prevalent in the workforce, corresponding to costly impairment in productivity and increased health care use. Digital mindfulness interventions are efficacious in improving sleep and mental health in the workplace; however, evidence supporting their pragmatic utility, potential for improving productivity, and ability to reduce employer costs is limited. Objective: This pragmatic, cluster randomized controlled trial aimed to evaluate the experimental effects of implementing a commercially available mindfulness app—Calm—in employees of a large, multisite employer in the United States. Outcomes included mental health (depression, anxiety, and stress), sleep (insomnia and daytime sleepiness), resilience, productivity impairment (absenteeism, presenteeism, overall work impairment, and non–work activity impairment), and health care use (medical visit frequency). Methods: Employees were randomized at the work site to receive either the Calm app intervention or waitlist control. Participants in the Calm intervention group were instructed to use the Calm app for 10 minutes per day for 8 weeks; individuals with elevated baseline insomnia symptoms could opt-in to 6 weeks of sleep coaching. All outcomes were assessed every 2 weeks, with the exception of medical visits (weeks 4 and 8 only). Effects of the Calm intervention on outcomes were evaluated via mixed effects modeling, controlling for relevant baseline characteristics, with fixed effects of the intervention on outcomes assessed at weeks 2, 4, 6, and 8. Models were analyzed via complete-case and intent-to-treat analyses. Results: A total of 1029 employees enrolled (n=585 in the Calm intervention group, including 101 who opted-in to sleep coaching, and n=444 in waitlist control). Of them, 192 (n=88 for the Calm intervention group and n=104 for waitlist) completed all 5 assessments. In the complete-case analysis at week 8, employees at sites randomized to the Calm intervention group experienced significant improvements in depression (P=.02), anxiety (P=.01), stress (P<.001), insomnia (P<.001), sleepiness (P<.001), resilience (P=.02), presenteeism (P=.01), overall work impairment (P=.004), and nonwork impairment (P<.001), and reduced medical care visit frequency (P<.001) and productivity impairment costs (P=.01), relative to the waitlist control. In the intent-to-treat analysis at week 8, significant benefits of the intervention were observed for depression (P=.046), anxiety (P=.01), insomnia (P<.001), sleepiness (P<.001), nonwork impairment (P=.04), and medical visit frequency (P<.001). Conclusions: The results suggest that the Calm app is an effective workplace intervention for improving mental health, sleep, resilience, and productivity and for reducing medical visits and costs owing to work impairment. Future studies should identify optimal implementation strategies that maximize employee uptake and large-scale implementation success across diverse, geographically dispersed employers. Trial Registration: ClinicalTrials.gov NCT05120310; https://clinicaltrials.gov/ct2/show/NCT05120310

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/38903

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 CONSORT (Consolidated Standards of Reporting Trials) diagram of study participation and analyzed data. *Note that participants may have been ineligible for more than one reason, all of which are reflected here. During the trial, participants could complete a subsequent assessment even if they missed a prior one.
Figure 1 CONSORT (Consolidated Standards of Reporting Trials) diagram of study participation and analyzed data. *Note that participants may have been ineligible for more than one reason, all of which are reflected here. During the trial, participants could complete a subsequent assessment even if they missed a prior one.CC BY · PubMed Central
Figure 2 Estimated marginal means indicating group differences in changes in mental health outcomes over time among study completers. *P<.05; **P<.01; ***P<.001. DASS-21: Depression Anxiety Stress Scale-21 item.
Figure 2 Estimated marginal means indicating group differences in changes in mental health outcomes over time among study completers. *P<.05; **P<.01; ***P<.001. DASS-21: Depression Anxiety Stress Scale-21 item.CC BY · PubMed Central
Figure 3 Estimated marginal means indicating group differences in changes in sleep outcomes over time among study completers. *P<.05; **P<.01; ***P<.001. ESS: Epworth Sleepiness Scale; ISI: Insomnia Severity Index.
Figure 3 Estimated marginal means indicating group differences in changes in sleep outcomes over time among study completers. *P<.05; **P<.01; ***P<.001. ESS: Epworth Sleepiness Scale; ISI: Insomnia Severity Index.CC BY · PubMed Central
Figure 4 Estimated marginal means indicating group differences in absenteeism and presenteeism over time among study completers. *P<.05; **P<.01; ***P<.001. WPAI: work productivity and activity impairment.
Figure 4 Estimated marginal means indicating group differences in absenteeism and presenteeism over time among study completers. *P<.05; **P<.01; ***P<.001. WPAI: work productivity and activity impairment.CC BY · PubMed Central
Figure 5 Estimated marginal means indicating group differences in changes in work and nonwork activity impairment over time among study completers. *P<.05; **P<.01; ***P<.001. WPAI: work productivity and activity impairment.
Figure 5 Estimated marginal means indicating group differences in changes in work and nonwork activity impairment over time among study completers. *P<.05; **P<.01; ***P<.001. WPAI: work productivity and activity impairment.CC BY · PubMed Central
Figure 6 Estimated marginal means indicating group differences in costs of work impairment over time among study completers.
Figure 6 Estimated marginal means indicating group differences in costs of work impairment over time among study completers.CC BY · PubMed Central
Figure 7 Average Calm app use per employee per week during the intervention period. This figure depicts the overall app use data (use of any component of the app), as well as the use of the most popular components. Less used components are not included in the figure such that the sum of the components presented does not encompass all app use.
Figure 7 Average Calm app use per employee per week during the intervention period. This figure depicts the overall app use data (use of any component of the app), as well as the use of the most popular components. Less used components are not included in the figure such that the sum of the components presented does not encompass all app use.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 65 references

Research works printed but not linked: 2

  1. Gethin, R, 1998, The Foundations of Buddhism
  2. Lovibond, SH, 1995, Manual for the Depression Anxiety Stress Scale

Cited by

See all 44

Metadata

Authors
Huberty, J. L., Espel-Huynh, H. M., Neher, T. L., & Puzia, M. E.
Affiliations
  • Arizona State University (US)
  • Boise State University (US)
Corresponding author
Huberty, Jennifer L
Venue
JMIR mHealth and uHealth
Published
2022-09-28
Volume
10
Issue
9
Pages
e38903
ISSN
2291-5222 (ISSN-L)
OpenAlex
W4297461929
Cited by
44
References
65
Citations by year
2026: 10 · 2025: 11 · 2024: 14 · 2023: 7 · 2022: 2
FWCI
7.76
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ScholarWorks (Boise State University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
mindfulness apps, workplace mental health, employee well-being, insomnia, sleep coaching, depression, anxiety, stress, resilience, presenteeism, absenteeism, work impairment, productivity, health care utilization, employer costs, digital mental health interventions, smartphone-based intervention, employee engagement
MeSH terms
Sleepiness, Humans, Sleep Initiation and Maintenance Disorders, Mental Health, Mobile Applications, Mindfulness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.