CoChat

A Gamified Mobile App That Helps People Develop the Metacognitive Skills to Cope With Stressful Situations and Difficult Emotions: Formative Assessment of the InsightApp

Open access
Amo, Victoria, Prentice, Mike, Lieder, Falk · 2023 · JMIR Formative Research

Published version of a preprint

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index; 5 of the 18 sources its claims cite were checked for support.

Abstract

Background: Ecological momentary interventions open up new and exciting possibilities for delivering mental health interventions and conducting research in real-life environments via smartphones. This makes designing psychotherapeutic ecological momentary interventions a promising step toward cost-effective and scalable digital solutions for improving mental health and understanding the effects and mechanisms of psychotherapy. Objective: The first objective of this study was to formatively assess and improve the usability and efficacy of a gamified mobile app, the InsightApp, for helping people learn some of the metacognitive skills taught in cognitive behavioral therapy, acceptance and commitment therapy, and mindfulness-based interventions. The app aims to help people constructively cope with stressful situations and difficult emotions in everyday life. The second objective of this study was to test the feasibility of using the InsightApp as a research tool for investigating the efficacy of psychological interventions and their underlying mechanisms. Methods: We conducted 2 experiments. In experiment 1 (n=65; completion rate: 63/65, 97%), participants (mean age 27, SD 14.9; range 19-55 years; 41/60, 68% female) completed a single session with the InsightApp. The intervention effects on affect, belief endorsement, and propensity for action were measured immediately before and after the intervention. Experiment 2 (n=200; completion rate: 142/200, 71%) assessed the feasibility of conducting a randomized controlled trial using the InsightApp. We randomly assigned participants to an experimental or a control condition, and they interacted with the InsightApp for 2 weeks (mean age 37, SD 12.16; range 20-78 years; 78/142, 55% female). Experiment 2 included all the outcome measures of experiment 1 except for the self-reported propensity to engage in predefined adaptive and maladaptive behaviors. Both experiments included user experience surveys. Results: In experiment 1, a single session with the app seemed to decrease participants’ emotional struggle, the intensity of their negative emotions, their endorsement of negative beliefs, and their self-reported propensity to engage in maladaptive coping behaviors (P<.001 in all cases; average effect size=−0.82). Conversely, participants’ endorsement of adaptive beliefs and their self-reported propensity to act in accordance with their values significantly increased (P<.001 in all cases; average effect size=0.48). Experiment 2 replicated the findings of experiment 1 (P<.001 in all cases; average effect size=0.55). Moreover, experiment 2 identified a critical obstacle to conducting a randomized controlled trial (ie, asymmetric attrition) and how it might be overcome. User experience surveys suggested that the app’s design is suitable for helping people apply psychotherapeutic techniques to cope with everyday stress and anxiety. User feedback provided valuable information on how to further improve app usability. Conclusions: In this study, we tested the first prototype of the InsightApp. Our encouraging preliminary results show that it is worthwhile to continue developing the InsightApp and further evaluate it in a randomized controlled trial. ©Victoria Amo, Mike Prentice, Falk Lieder.

Overview

CoChat Summary

TL;DR

The paper presents formative testing of the InsightApp, a gamified smartphone intervention that combines CBT, ACT, and mindfulness elements to train metacognitive coping skills. In two experiments, the app showed immediate pre–post improvements in emotional and cognitive outcomes, but the longitudinal prototype also revealed a major feasibility problem: asymmetric attrition.

Key findings

  • In experiment 1 (n=65; final analyzed sample 63), a single session significantly decreased perceived likelihood of unwanted actions (V=88; P<.001; effect size=0.79), emotional intensity (V=1; P<.001; 0.87), emotional struggle (V=43; P<.001; 0.83), and endorsement of maladaptive beliefs (V=53; P<.001; 0.82), while increasing perceived likelihood of beneficial actions (V=1549; P<.001; 0.68) and endorsement of adaptive beliefs (V=761; P<.001; 0.27).
  • In experiment 2 (n=200; final sample 142), the daily morning practice again improved outcomes from pre- to post-session: emotion intensity (t316.7=−5.959; P<.001; Cohen d=−0.67), emotional struggle (t236.4=−5.048; P<.001; d=−0.66), discouraging belief endorsement (t610.6=−7.385; P<.001; d=−0.60), and encouraging belief endorsement (t656.1=3.642; P<.001; d=0.28).
  • Attrition in experiment 2 was much higher in the experimental group than the control group: 41/100 (41%) vs 17/100 (17%), χ²1=12.8, P<.001.
  • User experience was positive: in experiment 1, 98% (62/63) agreed they developed a valuable daily-life skill, the app averaged 4.7/5 stars, and 95% (60/63) said nothing was confusing; in experiment 2, 86% (51/59) agreed they developed a valuable skill, the app averaged 4/5 stars, and 83% (49/59) said nothing was confusing.

Methods

  • Two formative experiments were conducted with iPhone-owning, English-speaking adults recruited and compensated via Prolific; experiment 1 used a pretest-posttest single-session design, and experiment 2 used a 2-week randomized design with experimental and control conditions.
  • The app intervention combined CBT (ABCDE cognitive restructuring), ACT (values reflection, cognitive defusion, acceptance), and mindfulness-based strategies through a reflection module plus two “metacognitive coaches” (meta-reasoning and meta-awareness).
  • Experiment 1 analyzed pre/post changes with nonparametric paired-sample Wilcoxon tests and summarized user experience with descriptive statistics; experiment 2 used linear mixed models for repeated pre/post morning-practice scores and a chi-square test to compare attrition.

Limitations

  • The paper explicitly states that experiment 1 lacked a control condition and that experiment 2 had asymmetric attrition, which prevented comparison of the experimental and control conditions.
  • The paper notes reliance on single-item measures as a possible limitation, although it says test-retest reliability was examined in a follow-up study.
  • Evident from the text: the studies measured immediate pre–post effects after practice, so they do not establish longer-term efficacy or clinical outcomes. The paper also says it did not measure whether participants actually performed the mindful breathing exercise, only the effect of being told to do it.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/44429

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Screenshots from the meta-reasoning coach. The figure shows example screens illustrating how the app guides the user to (A) reflect on the beliefs they hold when they feel a strong negative emotion, (B) reflect on the consequences of holding the maladaptive belief, and (C) challenge the belief. Screenshots D and E exemplify part of the process to customize an avatar representing the recognized maladaptive pattern.
Figure 1 Screenshots from the meta-reasoning coach. The figure shows example screens illustrating how the app guides the user to (A) reflect on the beliefs they hold when they feel a strong negative emotion, (B) reflect on the consequences of holding the maladaptive belief, and (C) challenge the belief. Screenshots D and E exemplify part of the process to customize an avatar representing the recognized maladaptive pattern.CC BY · PubMed Central
Figure 2 Screenshots from the meta-awareness coach. This figure shows examples of screens that the app uses to guide people to (A) rate the intensity of their emotion before breathing, (B) inhale, (C) exhale, and (D) rate the intensity of their emotion after breathing.
Figure 2 Screenshots from the meta-awareness coach. This figure shows examples of screens that the app uses to guide people to (A) rate the intensity of their emotion before breathing, (B) inhale, (C) exhale, and (D) rate the intensity of their emotion after breathing.CC BY · PubMed Central
Figure 3 Sliders and questions with example answers. (A) Example screen with a slider for rating the intensity of an emotion. (B) Example screen with a free-text field accompanied by example answers within a picker view. (C) Example of a screen that integrates both components. Sliders are placed directly under a question and are accompanied by a label that shows the current percentage value being selected.
Figure 3 Sliders and questions with example answers. (A) Example screen with a slider for rating the intensity of an emotion. (B) Example screen with a free-text field accompanied by example answers within a picker view. (C) Example of a screen that integrates both components. Sliders are placed directly under a question and are accompanied by a label that shows the current percentage value being selected.CC BY · PubMed Central
Figure 4 Results of experiment 1. This figure compares the outcome variables immediately before and immediately after the intervention. The scores were measured using a slider on a scale from 0 to 100. The 6 panels show scores for (A) the perceived likelihood of enacting the unwanted action, (B) the perceived likelihood of enacting the valued action, (C) the intensity of the emotion, (D) the degree of struggle with the emotion, (E) the degree of endorsement of the maladaptive belief, and (F) the degree of endorsement of the adaptive belief.
Figure 4 Results of experiment 1. This figure compares the outcome variables immediately before and immediately after the intervention. The scores were measured using a slider on a scale from 0 to 100. The 6 panels show scores for (A) the perceived likelihood of enacting the unwanted action, (B) the perceived likelihood of enacting the valued action, (C) the intensity of the emotion, (D) the degree of struggle with the emotion, (E) the degree of endorsement of the maladaptive belief, and (F) the degree of endorsement of the adaptive belief.CC BY · PubMed Central

Verification

Claims the paper makes

5 Valid · 0 Not valid · 9 Not checked · 71 Own results and interpretations

44 more claims

Create a free account to see all 85 claims and to verify the 3 references still open.

See all claims — free account
  • Probably not a substantial claim. 27
  • It may state two separate claims as one. 18
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 35 references

Research works printed but not linked: 3

  1. Segal ZV Williams JM Teasdale JD Mindfulness-Based Cognitive Therapy for Depression: A New Approach to Preventing Relapse. 2nd edition 2018 New York, NY, USA Guilford Press
  2. Leahy RL Cognitive Therapy Techniques: A Practitioner's Guide. 2nd edition 2017 New York, NY, USA Guilford Press
  3. Harris R ACT Made Simple: An Easy-To-Read Primer on Acceptance and Commitment Therapy. 2nd edition 2019 Oakland, CA, USA New Harbinger

Cited by

Metadata

Authors
Amo, V., Prentice, M., & Lieder, F.
Affiliations
Max Planck Society (DE)
Corresponding author
Amo, Victoria
Venue
JMIR Formative Research
Published
2023-06-16
Volume
7
Pages
e44429
ISSN
2561-326X (ISSN-L)
OpenAlex
W4327884691
Cited by
9
References
33
Citations by year
2026: 3 · 2025: 2 · 2024: 2 · 2023: 2
FWCI
2.32
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
metacognitive skills, ecological momentary intervention, digital mental health interventions, cognitive behavioral therapy, acceptance and commitment therapy, mindfulness-based interventions, stress coping, difficult emotions, negative beliefs, user experience, usability, mobile application, emotion regulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.