CoChat

A Randomized Controlled Trial of Multiple Versions of an Acceptance and Commitment Therapy Matrix App for Well-Being

The DOI matches its Crossref record, with a small difference in title or year; 27 of the 27 references it cites were found in a registry or an index; 2 of the 9 sources its claims cite were checked for support.

Abstract

Mobile apps may be useful in teaching psychological skills in a high-frequency, low-intensity intervention. The acceptance and commitment therapy (ACT) matrix is a visual tool to help develop psychological flexibility by categorizing moment-to-moment experience and is well suited to a mobile app. This pilot study tested the effects of a simple and complex version of a novel app using the ACT matrix in two distinct samples: help-seeking individuals (n = 35) and students receiving SONA credit (n = 63). Findings indicated no differences between app conditions and a waitlist condition in the SONA credit sample. However, in the help-seeking sample, improvements were found on well-being and valued action in participants who used the app, with greater improvements and app adoption for those using a complex version with additional skills. A mobile app based on the ACT matrix has benefits for help-seeking individuals, but supplementary features may be necessary to support consistent use and benefits. © The Author(s) 2017.

Overview

CoChat Summary

TL;DR

This pilot RCT tested simple and complex versions of an ACT matrix mobile app against waitlist in two samples and found no effects in a SONA credit sample, but improvements in distress, anxiety, and valued action among help-seeking adults, especially with the complex app. The authors conclude that a matrix app may benefit help-seeking/distressed individuals, but motivation and additional features may be important for engagement and effects.

Key findings

  • In the help-seeking sample (n = 35), significant time-by-condition interactions were found for distress, F(4, 20.30) = 3.92, p = .02, and anxiety, F(4, 20.82) = 3.07, p = .04, with trends for depression and stress (both p = .07); the complex matrix condition improved significantly on distress from baseline to posttreatment, t(21.08) = 3.51, p < .01, d = 1.26, while the simple matrix condition improved significantly on anxiety, t(20.74) = 2.95, p = .01, d = 1.11.
  • A significant time-by-condition effect was found for progress toward values in the help-seeking sample, F(4, 22.56) = 3.16, p = .03; the probability of reporting a toward move increased by 0.5% per app notification (exp(γ) = 1.005, p = .03), translating to a 15.00% increase after four weeks of consistent use.
  • In the SONA credit sample (n = 63), there were no effects between conditions over time on any outcome or process measure, and notification number did not predict the probability of making a toward move (p = .98).
  • App engagement differed by condition in the help-seeking sample: median total app contacts were 5 for simple matrix (M = 42.93, SD = 50.59) versus 42.5 for complex matrix (M = 53.60, SD = 45.58); 42.9% of simple-app participants never used the app, while all complex-app participants used it at least once and 40% used it 70+ times.

Methods

  • Pilot randomized controlled trial with 98 adults who owned a mobile phone: a SONA credit sample (n = 63) and a help-seeking community sample (n = 35), randomized to simple matrix app, complex matrix app, or waitlist for four weeks.
  • Measures included the DASS-21, MHC-SF, Valuing Questionnaire, System Usability Scale, additional satisfaction items, and automatically recorded app usage; analyses used mixed model repeated measures (MMRM) with intent-to-treat and hierarchical generalized linear models (HGLM) for toward/away move probability.
  • The simple app delivered 5 random daily notifications asking participants to identify toward versus away moves; the complex app added a daily check-in, goal setting, values activities, and mindfulness/acceptance activities.

Limitations

  • Stated: the help-seeking sample was relatively small, limiting power; results should be replicated in a fully powered RCT; researcher contact made the study less than naturalistic; no clinical or severity cutoffs were used; and both samples were young and ethnically homogeneous.
  • Stated: as a low-intensity intervention, small effect sizes would be reasonable and may have been difficult to detect.
  • Evident from the text: adherence was relatively low, the complex app’s additional skills were rarely used (median 2.5 other skills exercises), and the SONA sample was incentivized to use the app, which may have contributed to the different results.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1177/0145445517748561

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

2 Valid · 0 Not valid · 6 Not checked · 91 Own results and interpretations

36 more claims

Create a free account to see all 99 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 45
  • Probably not a substantial claim. 20
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(2, 32) = 4.26reported p = .02 · recomputed p = .023

    “F (2, 32) = 4.26, p = .02”

  • Consistentt(22) = 3.36reported p < .01 · recomputed p = .003

    “t (22) = 3.36, p < .01”

  • ConsistentF(4, 20.3) = 3.92reported p = .02 · recomputed p = .017

    “F (4, 20.30) = 3.92, p = .02”

  • ConsistentF(4, 20.82) = 3.07reported p = .04 · recomputed p = .039

    “F (4, 20.82) = 3.07, p = .04”

  • ConsistentF(4, 20.38) = 2.61reported p = .07 · recomputed p = .066

    “F (4, 20.38) = 2.61, p = .07”

5 of 33 · the rest aren’t loaded

28 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 27 references

Research works printed but not linked: 2

  1. Polk K. L., 2014, The ACT Matrix: A new approach to building psychological flexibility across settings and populations
  2. Twohig M. P., 2017, Psychiatric Clinics, 40, 751

Cited by

See all 45

Metadata

Authors
Krafft, J., Potts, S., Schoendorff, B., & Levin, M. E.
Affiliations
  • Utah State University (US)
  • Institut universitaire en santé mentale de Montréal (CA)
Corresponding author
Krafft, Jennifer
Venue
Behavior Modification
Published
2017-12-20
Volume
43
Issue
2
Pages
246-272
ISSN
  • 0145-4455 (ISSN-L)
  • 1552-4167
OpenAlex
W2777934163
Cited by
45
References
24
Citations by year
2026: 4 · 2025: 6 · 2024: 4 · 2023: 8 · 2022: 10 · 2021: 9 · 2020: 1 · 2019: 3
FWCI
1.21
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Behavior Modification (publishedVersion)
  • PubMed (publishedVersion)
  • Digital Commons - USU (Utah State University) (submittedVersion)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
acceptance and commitment therapy, mobile application, psychological flexibility, well-being, help-seeking, valued action, app adoption, low-intensity intervention, mental training, students
MeSH terms
Help-Seeking Behavior, Adult, Anxiety, Attitude to Health, Canada, Depression, Female, Humans, Male, Personal Satisfaction, Pilot Projects, Surveys and Questionnaires, Stress, Psychological, Students, United States, Universities, Young Adult, Mobile Applications, Acceptance and Commitment Therapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-26, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-26 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Randomized Controlled Trial of Multiple Versions of an Acceptance and Commitment Therapy Matrix App for Well-Being. https://app.cochat.ai/papers/10.1177/0145445517748561
The paper
Krafft, J., Potts, S., Schoendorff, B., & Levin, M. E. (2019). A Randomized Controlled Trial of Multiple Versions of an Acceptance and Commitment Therapy Matrix App for Well-Being. Behavior Modification. https://doi.org/10.1177/0145445517748561

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.