CoChat

Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation

Open access
Voth, Melissa, Chisholm, Shannon, Sollid, Hannah, Jones, Chelsea, Smith-MacDonald, Lorraine, Brémault-Phillips, Suzette · 2022 · JMIR mHealth and uHealth

Published version of a preprint

The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index; 39 of the 98 sources its claims cite were checked for support.

Abstract

BACKGROUND: Military members (MMs) and public safety personnel (PSP) are vulnerable to occupational stress injuries because of their job demands. When MMs and PSP transition out of these professions, they may continue to experience mental health challenges. The development and implementation of resilience-building mobile health (mHealth) apps as an emergent mental health intervention platform has allowed for targeted, cost-effective, and easily accessible treatment when in-person therapy may be limited or unavailable. However, current mHealth app development is not regulated, and often lacks both clear evidence-based research and the input of health care professionals. OBJECTIVE: This study aims to evaluate the evidence-based quality, efficacy, and effectiveness of resilience-building mobile apps targeted toward the MMs, PSP, and veteran populations via a scoping literature review of the current evidence base regarding resilience apps for these populations and an evaluation of free resilience apps designed for use among these populations. METHODS: The studies were selected using a comprehensive search of MEDLINE, CINAHL Plus, PsycINFO, SocINDEX, Academic Search Complete, Embase, and Google and were guided by PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews). A narrative synthesis of the resulting papers was performed. The Alberta Rating Index for Apps was used to conduct a review of each of the identified apps. The inclusion criteria consisted of apps that were free to download in either the Google Play Store or the Apple App Store; updated within the last 3 years; available in English and in Canada; and intended for use by MMs, veterans, and PSP. RESULTS: In total, 22 apps met the inclusion criteria for evaluation. The resilience strategies offered by most apps included psychoeducation, mindfulness, cognitive behavioral therapy, and acceptance and commitment therapy. Overall, 50% (11/22) of apps had been tested in randomized controlled trials, 7 (32%) apps had been evaluated using other research methods, and 5 (23%) apps had not been studied. Using the Alberta Rating Index for Apps, the app scores ranged from 37 to 56 out of 72, with higher rated apps demonstrating increased usability and security features. CONCLUSIONS: The mHealth apps reviewed are well-suited to providing resilience strategies for MMs, PSP, and veterans. They offer easy accessibility to evidence-based tools while working to encourage the use of emotional and professional support with safety in mind. Although not intended to function as a substitute for professional services, research has demonstrated that mHealth apps have the potential to foster a significant reduction in symptom severity for posttraumatic stress disorder, depression, anxiety, and other mental health conditions. In clinical practice, apps can be used to supplement treatment and provide clients with population-specific confidential tools to increase engagement in the treatment process. ©Melissa Voth, Shannon Chisholm, Hannah Sollid, Chelsea Jones, Lorraine Smith-MacDonald, Suzette Brémault-Phillips. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 19.01.2022.

Overview

CoChat Summary

TL;DR

This paper combines a scoping review and an app evaluation to assess resilience-building mHealth apps for military members, veterans, and public safety personnel. Across 22 apps, the authors found some evidence of benefit and generally decent quality, but also major gaps in evidence, social support features, and privacy/security.

Key findings

  • The scoping review identified 22 apps; 11 (50%) had been tested in randomized controlled trials, 7 (32%) using other methods, and 5 (23%) had not been research trialed.
  • In the app review, ARIA scores ranged from 37 to 56 out of 72; the highest-scoring apps were R2MR, PTSD Coach, and AIMS for Anger Management (each 56/72), and the lowest were Mindarma (37/72), Breathe2Relax (38/72), and High Res (39/72).
  • Common resilience strategies across the apps included mindfulness (8/22; 36%), psychoeducation (4/22; 18%), and cognitive behavioral therapy.
  • The paper reports that 15/22 (68%) apps used evidence-based strategies/components, but no app fully addressed all 6 pillars of resilience; 5 addressed 5 of 6 pillars, 12 addressed 4 or more, and 20 addressed 2 or more.

Methods

  • The study used a scoping literature review guided by PRISMA-ScR, searching MEDLINE, CINAHL Plus, PsycINFO, SocINDEX, Academic Search Complete, Embase, and Google between December 18 and December 20, 2020.
  • Eligibility was limited to studies from 2000 onward involving military, veteran, or public safety personnel and apps focused on resilience or self-regulatory strategies; app evaluation included only free, English-language apps available in Canada.
  • Included apps were rated by 2 reviewers using the Alberta Rating Index for Apps (ARIA), and the review used narrative synthesis.

Limitations

  • The paper states that only English-language studies were included, app selection was limited to apps available in Canada, and the apps were not tested on Android devices because the researchers only had access to iPhones.
  • The authors note that the ARIA is relatively new and not extensively validated, and that their results reflect the clinician perspective only, which could create bias; they recommend future inclusion of end users.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/26453

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Pillars of mental resilience [21,22].
Figure 1 Pillars of mental resilience [21,22].CC BY · PubMed Central
Figure 2 A PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) chart for the systematic review study identification, selection, exclusion, and inclusion.
Figure 2 A PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) chart for the systematic review study identification, selection, exclusion, and inclusion.CC BY · PubMed Central
Figure 3 Highest scoring apps on Alberta Rating Index for Apps.
Figure 3 Highest scoring apps on Alberta Rating Index for Apps.CC BY · PubMed Central

Verification

Claims the paper makes

23 Valid · 8 Not valid · 21 Not checked · 95 Own results and interpretations

69 more claims · 11 with their cited sources checked

Create a free account to see all 147 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 43
  • Probably not a substantial claim. 47

Create a free account to see these claims.

Citations

Cites

Research works printed but not linked: 2

  1. Roy, M, 2015, Stud Health Technol Inform, 219, 123
  2. 10.3316/informit.553541068174068 · doi:10.3316/informit.553541068174068

Cited by

See all 35

Metadata

Authors
Voth, M., Chisholm, S., Sollid, H., Jones, C., Smith-MacDonald, L., & Brémault-Phillips, S.
Affiliations
  • University of Alberta (CA)
  • Leiden University (NL)
Corresponding author
Jones, Chelsea
Venue
JMIR mHealth and uHealth
Published
2022-01-19
Volume
10
Issue
1
Pages
e26453
ISSN
2291-5222 (ISSN-L)
OpenAlex
W3215045341
Cited by
35
References
52
Citations by year
2026: 9 · 2025: 10 · 2024: 7 · 2023: 5 · 2022: 4
FWCI
0.64
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Clinical Psychology › Resilience and Mental Health
Keywords
mobile health apps, military personnel, veterans, public safety personnel, app quality assessment, free apps, psychoeducation, mindfulness, cognitive behavioral therapy, acceptance and commitment therapy, mental health interventions, suicide prevention
MeSH terms
Alberta, Humans, Veterans, Telemedicine, Mobile Applications, Acceptance and Commitment Therapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.