CoChat

Evaluation of an App-Delivered Psychological Flexibility Skill Training Intervention for Medical Student Burnout and Well-being: Randomized Controlled Trial

Open access

The DOI matches its Crossref record; 105 of the 106 references it cites were found in a registry or an index; 64 of the 135 sources its claims cite were checked for support.

Abstract

Background: Physician burnout is a common problem, with onset frequently occurring during undergraduate education. Early intervention strategies that train medical students in psychological flexibility skills could support well-being and mitigate burnout risks associated with unmodifiable career stressors. There is a need for randomized controlled trials to assess effectiveness. As psychological flexibility varies contextually and among individuals, tailoring interventions may improve outcomes. Smartphone apps can facilitate individualization and accessibility, and the evaluation of this approach is an identified research priority. Objective: This study aimed to evaluate the effectiveness of a stand-alone app–delivered Acceptance and Commitment Training intervention for improving medical students’ self-reported burnout, well-being, psychological flexibility, and psychological distress outcomes. We aimed to explore whether an individualized app would demonstrate benefits over a nonindividualized version. Methods: This parallel randomized controlled trial was conducted with a sample of medical students from 2 Australian universities (N=143). Participants were randomly allocated to 1 of 3 intervention arms (individualized, nonindividualized, and waitlist) using a 1:1:1 allocation ratio. Individualized and nonindividualized participants were blinded to group allocation. The 5-week intervention included an introductory module (stage 1) and on-demand access to short skill training activities (stage 2), which students accessed at their own pace. Stage 2 was either nonindividualized or individualized to meet students’ identified psychological flexibility training needs. Results: The mean differences in change from baseline between the intervention groups and the waitlist group were not statistically significant for burnout outcomes: exhaustion (primary; individualized: −0.52, 95% CI −3.70 to 2.65, P=.75; nonindividualized: 1.60, 95% CI −1.84 to 5.03, P=.37), cynicism (individualized: −1.26, 95% CI −4.46 to 1.94, P=.44; nonindividualized: 1.00, 95% CI −2.45 to 4.46, P=.57), and academic efficacy (individualized: 0.94, 95% CI −0.90 to 2.79, P=.32; nonindividualized: 2.02, 95% CI 0.02-4.03, P=.05). Following the intervention, the individualized group demonstrated improved psychological flexibility (0.50, 95% CI 0.12-0.89; P=.01), reduced inflexibility (0.48, 95% CI −0.92 to −0.04; P=.04), and reduced stress (−6.89, 95% CI −12.01 to 5.99; P=.01), and the nonindividualized group demonstrated improved well-being (6.46, 95% CI 0.49-12.42; P=.04) and stress (−6.36, 95% CI −11.90 to −0.83; P=.03) compared with waitlist participants. Between-group differences for the individualized and nonindividualized arms were not statistically significant. High attrition (75/143, 52.4%) was observed. Conclusions: This trial provides early support for the potential benefits of Acceptance and Commitment Training for medical student well-being and psychological outcomes and demonstrates that psychological flexibility and inflexibility can be trained using a smartphone app. Although postintervention burnout outcomes were not statistically significant, improvements in secondary outcomes could indicate early risk mitigation. Replication studies with larger samples and longer-term follow-up are required, and future research should focus on improving implementation frameworks to increase engagement and optimize individualization methods. ©Elizabeth Ditton, Brendon Knott, Nicolette Hodyl, Graeme Horton, Christopher Oldmeadow, Frederick Rohan Walker, Michael Nilsson.

Overview

CoChat Summary

## TL;DR

This 3-arm randomized controlled trial tested a 5-week app-delivered Acceptance and Commitment Training intervention for medical students (N=143) and found no significant effects on burnout outcomes at postintervention. However, the app improved some secondary outcomes: psychological flexibility, inflexibility, stress, well-being, and depression in one or both active arms, with high attrition (52.4%).

## Key findings

  • No statistically significant differences versus waitlist were found for the primary burnout outcome, exhaustion, or for cynicism; academic efficacy was also not significantly improved in the individualized arm, and was borderline in the nonindividualized arm (P=.05).
  • Compared with waitlist, the individualized group showed improved psychological flexibility (0.50; P=.01), reduced psychological inflexibility (P=.04), reduced stress (P=.01), and reduced depression (P=.046).
  • Compared with waitlist, the nonindividualized group showed improved well-being (P=.04) and reduced stress (P=.03).
  • There were no statistically significant differences between the individualized and nonindividualized arms on any outcome; attrition was 75/143 (52.4%), and only 21/73 (29%) of intervention participants met adherence criteria.

## Methods

  • Parallel 3-arm randomized controlled trial of a 5-week smartphone app (“BiSi: Build it. Sustain it.”) delivering Acceptance and Commitment Training, with individualized, nonindividualized, and waitlist conditions.
  • Sample: medical students from 2 Australian universities; N=143 enrolled, with the sampling frame drawn from 778 students in first, second, fourth, and fifth years of the Joint Medical Program.
  • Main analysis: intention-to-treat linear mixed regression models for repeated measures from baseline to 5-week postintervention, with a hierarchical testing procedure for the primary outcome and separate models for burnout, well-being, psychological flexibility/inflexibility, depression, anxiety, and stress.

## Limitations

  • The paper states it was underpowered to detect differences between individualized and nonindividualized groups, and notes the absence of prior within-person correlation data plus high attrition as a limitation.
  • The authors caution that the small sample size and multiple between-group comparisons increase risk of type-I and type-II errors.
  • Evident from the text: generalizability may be limited by the predominantly nonindigenous Australian sample with a slight skew toward female participants, and by high nonadherence/attrition that may have reduced the distinction between intervention arms.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/42566

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Participant flow diagram. II: individualized intervention; NI: nonindividualized intervention; WL: waiting list.
Figure 1 Participant flow diagram. II: individualized intervention; NI: nonindividualized intervention; WL: waiting list.CC BY · PubMed Central
Figure 2 Mean psychological flexibility scores by intervention group at baseline and postintervention measurement.
Figure 2 Mean psychological flexibility scores by intervention group at baseline and postintervention measurement.CC BY · PubMed Central
Figure 3 Mean stress scores by intervention group at baseline and postintervention measurement.
Figure 3 Mean stress scores by intervention group at baseline and postintervention measurement.CC BY · PubMed Central

Verification

Claims the paper makes

45 Valid · 0 Not valid · 25 Not checked · 112 Own results and interpretations

93 more claims · 14 with their cited sources checked

Create a free account to see all 182 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 44
  • It may state two separate claims as one. 48

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Research works printed but not linked: 1

  1. Lovibond, SH, 1995, Manual for the Depression Anxiety Stress Scales. 2nd edition

Cited by

See all 22

Metadata

Authors
Ditton, E., Knott, B., Hodyl, N., Horton, G., Oldmeadow, C., Walker, F. R., & Nilsson, M.
Affiliations
  • Hunter Medical Research Institute (AU)
  • University of Newcastle Australia (AU)
  • Nanyang Technological University (SG)
Corresponding author
Ditton, Elizabeth
Venue
JMIR Mental Health
Published
2023-02-06
Volume
10
Pages
e42566
ISSN
2368-7959 (ISSN-L)
OpenAlex
W4319295303
Cited by
22
References
106
Citations by year
2026: 8 · 2025: 10 · 2024: 4
FWCI
7.74
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
  • NOVA (University of Newcastle Australia) (submittedVersion)
Topics
  • Health Sciences › Health Professions › General Health Professions › Healthcare professionals’ stress and burnout
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
medical student burnout, psychological flexibility, acceptance and commitment training, personalized interventions, well-being, psychological distress, medical education, physician burnout

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.