Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation
Open accessPublished version of a preprint
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index; 39 of the 98 sources its claims cite were checked for support.
Abstract
BACKGROUND: Military members (MMs) and public safety personnel (PSP) are vulnerable to occupational stress injuries because of their job demands. When MMs and PSP transition out of these professions, they may continue to experience mental health challenges. The development and implementation of resilience-building mobile health (mHealth) apps as an emergent mental health intervention platform has allowed for targeted, cost-effective, and easily accessible treatment when in-person therapy may be limited or unavailable. However, current mHealth app development is not regulated, and often lacks both clear evidence-based research and the input of health care professionals. OBJECTIVE: This study aims to evaluate the evidence-based quality, efficacy, and effectiveness of resilience-building mobile apps targeted toward the MMs, PSP, and veteran populations via a scoping literature review of the current evidence base regarding resilience apps for these populations and an evaluation of free resilience apps designed for use among these populations. METHODS: The studies were selected using a comprehensive search of MEDLINE, CINAHL Plus, PsycINFO, SocINDEX, Academic Search Complete, Embase, and Google and were guided by PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews). A narrative synthesis of the resulting papers was performed. The Alberta Rating Index for Apps was used to conduct a review of each of the identified apps. The inclusion criteria consisted of apps that were free to download in either the Google Play Store or the Apple App Store; updated within the last 3 years; available in English and in Canada; and intended for use by MMs, veterans, and PSP. RESULTS: In total, 22 apps met the inclusion criteria for evaluation. The resilience strategies offered by most apps included psychoeducation, mindfulness, cognitive behavioral therapy, and acceptance and commitment therapy. Overall, 50% (11/22) of apps had been tested in randomized controlled trials, 7 (32%) apps had been evaluated using other research methods, and 5 (23%) apps had not been studied. Using the Alberta Rating Index for Apps, the app scores ranged from 37 to 56 out of 72, with higher rated apps demonstrating increased usability and security features. CONCLUSIONS: The mHealth apps reviewed are well-suited to providing resilience strategies for MMs, PSP, and veterans. They offer easy accessibility to evidence-based tools while working to encourage the use of emotional and professional support with safety in mind. Although not intended to function as a substitute for professional services, research has demonstrated that mHealth apps have the potential to foster a significant reduction in symptom severity for posttraumatic stress disorder, depression, anxiety, and other mental health conditions. In clinical practice, apps can be used to supplement treatment and provide clients with population-specific confidential tools to increase engagement in the treatment process. ©Melissa Voth, Shannon Chisholm, Hannah Sollid, Chelsea Jones, Lorraine Smith-MacDonald, Suzette Brémault-Phillips. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 19.01.2022.
Overview
CoChat Summary
TL;DR
This paper combines a scoping review and an app evaluation to assess resilience-building mHealth apps for military members, veterans, and public safety personnel. Across 22 apps, the authors found some evidence of benefit and generally decent quality, but also major gaps in evidence, social support features, and privacy/security.
Key findings
- The scoping review identified 22 apps; 11 (50%) had been tested in randomized controlled trials, 7 (32%) using other methods, and 5 (23%) had not been research trialed.
- In the app review, ARIA scores ranged from 37 to 56 out of 72; the highest-scoring apps were R2MR, PTSD Coach, and AIMS for Anger Management (each 56/72), and the lowest were Mindarma (37/72), Breathe2Relax (38/72), and High Res (39/72).
- Common resilience strategies across the apps included mindfulness (8/22; 36%), psychoeducation (4/22; 18%), and cognitive behavioral therapy.
- The paper reports that 15/22 (68%) apps used evidence-based strategies/components, but no app fully addressed all 6 pillars of resilience; 5 addressed 5 of 6 pillars, 12 addressed 4 or more, and 20 addressed 2 or more.
Methods
- The study used a scoping literature review guided by PRISMA-ScR, searching MEDLINE, CINAHL Plus, PsycINFO, SocINDEX, Academic Search Complete, Embase, and Google between December 18 and December 20, 2020.
- Eligibility was limited to studies from 2000 onward involving military, veteran, or public safety personnel and apps focused on resilience or self-regulatory strategies; app evaluation included only free, English-language apps available in Canada.
- Included apps were rated by 2 reviewers using the Alberta Rating Index for Apps (ARIA), and the review used narrative synthesis.
Limitations
- The paper states that only English-language studies were included, app selection was limited to apps available in Canada, and the apps were not tested on Android devices because the researchers only had access to iPhones.
- The authors note that the ARIA is relatively new and not extensively validated, and that their results reflect the clinician perspective only, which could create bias; they recommend future inclusion of end users.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Pillars of mental resilience [21,22].](https://figures.cochat.ai/paper-figures/c0cbd94f35374c91ae2257b20a9e621f/efficacy-effectiveness-and-quality-of-resilience-building-mobile-health-apps-for-figure-1.jpg)


Verification
Claims the paper makes
23 Valid · 8 Not valid · 21 Not checked · 95 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“there was an observed lack of social connectedness components within the apps reviewed [14,23,36,46].”
§ Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation > Results > Objective 1: Scoping Literature Review
What the sources say
- Not checked — no full text of the sourcecites [14] source
- Not checked — no full text of the sourcecites [23] source
- Disputedcites [36] sourceExperimental — accuracy not yet measured
The Methods section says the review coded social interaction because it was commonly employed in the reviewed studies. The Discussion (RQ2) likewise says social interaction was commonly used to engage users, contrary to an observed lack of such components. The indexed copy provides no page numbers for these passages. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Could not verifycites [46] sourceExperimental — accuracy not yet measured
The Introduction discusses social relationships as an aspect of well-being, and the Methods describe the two apps used in a randomized trial. Neither section reports a review of apps or an observed lack of social-connectedness components. Searches for social-connectedness components and social features found no passage making that observation; page numbers were unavailable in our copy. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In addition, mHealth apps may fill a gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
§ Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation > Introduction > Digital Health
What the sources say
- Partly supportedcites [8] sourceExperimental — accuracy not yet measured
The Introduction’s Background section says apps may decrease stigma, reduce wait times, and offer mental health support to military members and veterans concerned about stigmatization. The Conclusions also identify geographical isolation as a barrier apps may help address. The paper does not identify high job mobility as a barrier, so that part of the attributed claim is unsupported. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [30] source
- Not checked — no full text of the sourcecites [33] source
- Partly supportedcites [34] sourceExperimental — accuracy not yet measured
The review identifies public stigma and logistical barriers for military personnel and veterans (Conclusions; Other potential barriers to care), and reports that waiting times are perceived as a barrier to VA care (Research on barriers to care in military and veteran populations). It does not address job mobility, geographic restrictions, public safety personnel, or whether mHealth apps can fill the gap. (LLM, conf=0.86)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Evidence illustrates that resilience training and interventions, primarily those focused on coping skills and self-efficacy, can work to support a decrease in psychological distress and symptoms of PTSD [13-16].”
§ Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation > Introduction > Resilience
What the sources say
- Not matchedcites [13] Combat-related trauma, posttraumatic stress disorder, and moral injury in combat medics: a comprehensive survey of the literature and critical analysisProQuest2021-12-23https://www.proquest.com/openview/ae7c04d8fdea0b1e660499b5ff4f8589/1?pq-origsite=gscholar&cbl=18750&diss=y
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [14] source
- Partly supportedcites [15] sourceExperimental — accuracy not yet measured
The Results (Secondary Outcomes; page not available) report a sustained improvement in active coping after resilience training. But the study measured resilience rather than reductions in psychological distress or PTSD symptoms, and the Discussion (Principal Findings; page not available) describes PTSD symptoms only in relation to a separate study of baseline resilience. The cited paper also does not identify self-efficacy as a primary focus of its intervention. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [16] source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Specific to the MMs, PSP, and veteran populations, health care professionals (HCPs) are well-suited to use mHealth tools, such as apps, to supplement treatment and provide clients with immediate tools to help them overcome psychological impairment related to their traumas [9,31].”
§ Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation > Introduction > Digital Health
What the sources say
- Not checked — no full text of the sourcecites [9] source
- Could not verifycites [31] sourceExperimental — accuracy not yet measured
The Treatments section describes therapist-led exposure therapy using a treadmill and projected virtual environment, not an mHealth app. The Conclusions report reduced PTSD symptoms in veterans receiving that intervention, but our copy does not address clinicians using apps to supplement treatment or give clients immediate tools. Searches for mHealth, apps, and mobile tools found no supporting passage; page numbers were unavailable for these passages. (LLM, conf=0.74)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“More importantly, there is a paucity of peer-reviewed research published regarding mHealth apps to determine their uptake, impact, or the best practices for their development and regulation [12,30,37].”
§ Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation > Introduction > Digital Health
What the sources say
- Not checked — no full text of the sourcecites [12] source
- Not checked — no full text of the sourcecites [30] source
- Could not verifycites [37] sourceExperimental — accuracy not yet measured
The Abstract and Introduction discuss limited research on engagement and usability in health-related websites. Searches for mHealth apps, uptake, impact, and regulation found no passage addressing whether peer-reviewed research on those topics is scarce. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
69 more claims · 11 with their cited sources checked
Create a free account to see all 147 claims and to verify the 2 references still open.
- It may state two separate claims as one. 43
- Probably not a substantial claim. 47
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“The PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) was used to guide this scoping review and app search, both of which were conducted between December 18, 2020, and December 20, 2020 [38].”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Resilience definitions, theory, and challenges: interdisciplinary perspectives
Southwick, S. M., Bonanno, G. A., Masten, A. S., Panter-Brick, C., & Yehuda, R. (2014) · European Journal of Psychotraumatology · doi:10.3402/ejpt.v5.25338 · Cited by 2,968 · cited 3×
“For this study, we have defined resilience as follows: “The dynamic process of overcoming adverse experiences through the use of internal and external resources in order to foster healthy psychological functioning” [13,17-19].”
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 3×
“…with other app evaluation tools, such as the Mobile App Rating Scale, may allow for a more in-depth understanding of mHealth apps; however, for the MMs and PSP populations, the ARIA’s additional security and privacy questions provide a clearer understanding of population-specific concerns [7,44].”
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
Gamification for health and wellbeing: A systematic review of the literature
Johnson, D., Deterding, S., Kuhn, K.-A., Staneva, A., Stoyanov, S., & Hides, L. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.10.002 · Cited by 1,237
Mental Disorder Symptoms among Public Safety Personnel in Canada
Carleton, R. N., Afifi, T. O., Turner, S., Taillieu, T., Duranceau, S., LeBouthillier, D. M., Sareen, J., Ricciardelli, R., MacPhee, R. S., Groll, D., et al. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717723825 · Cited by 558 · cited 4×
“This study also found that 36.7% of surveyed Canadian police officers in particular screened positive for mental health conditions, primarily PTSD [1].”
InfluentialIribarren, S. J., Cato, K., Falzon, L., & Stone, P. W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0170581 · Cited by 519 · cited 1×
“Many apps are also cost-effective and may be beneficial where therapy services are limited or unavailable [35,36].”
A qualitative study of user perceptions of mobile health apps
Peng, W., Kanthawala, S., Yuan, S., & Hussain, S. A. (2016) · BMC Public Health · doi:10.1186/s12889-016-3808-0 · Cited by 465 · cited 1×
“Creating client autonomy through app literacy will allow users to take more control in choosing treatment methods and encourage greater client-centered practice [59].”
Vogt, D. (2011) · Psychiatric Services · doi:10.1176/ps.62.2.pss6202_0135 · Cited by 371 · cited 1×
“…gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
Medical apps for smartphones: lack of evidence undermines quality and safety
Buijink, A. W. G., Visser, B. J., & Marshall, L. (2013) · Evidence Based Medicine · doi:10.1136/eb-2012-100885 · Cited by 303 · cited 2×
“Specific to the MMs, PSP, and veteran populations, health care professionals (HCPs) are well-suited to use mHealth tools, such as apps, to supplement treatment and provide clients with immediate tools to help them overcome psychological impairment related to their traumas [9,31].”
Preliminary Evaluation of PTSD Coach, a Smartphone App for Post-Traumatic Stress Symptoms
Kuhn, E., Greene, C., Hoffman, J., Nguyen, T., Wald, L., Schmidt, J., Ramsey, K. M., & Ruzek, J. (2014) · Military Medicine · doi:10.7205/milmed-d-13-00271 · Cited by 289
Mohr, D. C., Schueller, S. M., Riley, W. T., Brown, C. H., Cuijpers, P., Duan, N., Kwasny, M. J., Stiles-Shields, C., & Cheung, K. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4391 · Cited by 216 · cited 2×
“A collaborative approach to development, using both expert and user input, has been noted in recent studies as an effective approach to increasing the success of apps [57,58,60].”
Resilience from a developmental systems perspective
Masten, A. S. (2019) · World Psychiatry · doi:10.1002/wps.20591 · Cited by 214
Virtual Reality Applications for Stress Management Training in the Military
Pallavicini, F., Argenton, L., Toniazzi, N., Aceti, L., & Mantovani, F. (2016) · Aerospace Medicine and Human Performance · doi:10.3357/amhp.4596.2016 · Cited by 182 · cited 1×
“Evidence illustrates that resilience training and interventions, primarily those focused on coping skills and self-efficacy, can work to support a decrease in psychological distress and symptoms of PTSD [13-16].”
Litvin, S., Saunders, R., Maier, M. A., & Lüttke, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237220 · Cited by 177 · cited 3×
“In much of the literature, gamification and the integration of social components strengthened mHealth app use and engagement, resulting in more positive outcomes and an increased sense of peer support for the MMs and PSP populations [14,36,46]; however, this was lacking in practice.”
Possemato, K., Kuhn, E., Johnson, E., Hoffman, J. E., Owen, J. E., Kanuri, N., De Stefano, L., & Brooks, E. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.09.005 · Cited by 167 · cited 1×
“Some apps, such as PTSD Coach, were demonstrated to be more effective in managing and reducing PTSD symptoms when used with the support of an HCP as opposed to independent use [43,47].”
By the numbers: ratings and utilization of behavioral health mobile applications
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., & Areán, P. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0129-6 · Cited by 164 · cited 1×
“The latest estimates suggest that there are between 165,000 and 325,000 health and wellness apps currently available for download [10,11].”
Colder Carras, M., Kalbarczyk, A., Wells, K., Banks, J., Kowert, R., Gillespie, C., & Latkin, C. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.08.044 · Cited by 128
Bush, N. E., Smolenski, D. J., Denneson, L. M., Williams, H. B., Thomas, E. K., & Dobscha, S. K. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600283 · Cited by 124 · cited 1×
“…gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
Lee, J. E. C., Sudom, K. A., & Zamorski, M. A. (2013) · Journal of Occupational Health Psychology · doi:10.1037/a0033059 · Cited by 114 · cited 1×
“…in MMs have independently and not always cohesively explored the constructs of personality, positive affect, mastery, and social support [53]; neuroticism, military hardiness, and problem-solving coping [54]; and conscientiousness, emotional stability, and positive social interactions [55].”
Green, K. T., Hayward, L. C., Williams, A. M., Dennis, P. A., Bryan, B. C., Taber, K. H., Mid-Atlantic Mental Illness Research, E. A. C. C. W., Davidson, J. R. T., Beckham, J. C., Calhoun, P. S., et al. (2014) · Assessment · doi:10.1177/1073191114524014 · Cited by 111
The Road to Mental Readiness for First Responders: A Meta-Analysis of Program Outcomes
Szeto, A., Dobson, K. S., & Knaak, S. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719842562 · Cited by 102 · cited 1×
“In addition, R2MR , which stands for road to mental readiness, was found to be effective in increasing resilience and help-seeking behaviors in the participants and in reducing mental health stigma for individuals and entire workplaces [45].”
Joyce, S., Shand, F., Lal, T. J., Mott, B., Bryant, R. A., & Harvey, S. B. (2019) · Journal of Medical Internet Research · doi:10.2196/12894 · Cited by 101
van der Meulen, E., van der Velden, P. G., van Aert, R. C. M., & van Veldhoven, M. J. P. M. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.112814 · Cited by 79 · cited 1×
“This problem is compounded when exploring how the construct is defined by the militaries of other countries (ie, Australia, United Kingdom, and United States vs Canada) and how it may enhance mental health [56].”
Rusu, C., Zamorski, M. A., Boulos, D., & Garber, B. G. (2016) · The Canadian Journal of Psychiatry · doi:10.1177/0706743716628856 · Cited by 68 · cited 1×
“MMs in the Canadian Armed Forces (CAF) are at greater risk of mental health disorders and suicide risk compared with the Canadian civilian population [3].”
Police Department Personnel Stress Resilience Training: An Institutional Case Study
Weltman, G., Lamon, J., Freedy, E., & Chartrand, D. (2014) · Global Advances in Health and Medicine · doi:10.7453/gahmj.2014.015 · Cited by 65 · cited 1×
“Sessions that provide instruction around optimal app use patterns as well as the app’s purpose, can increase the user’s knowledge and therefore adherence to treatment programs that uses mHealth components [43,48,49].”
Canadian Public Safety Personnel and Occupational Stressors: How PSP Interpret Stressors on Duty
Ricciardelli, R., Czarnuch, S., Carleton, R. N., Gacek, J., & Shewmake, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17134736 · Cited by 62 · cited 1×
“Globally, military members (MMs) and public safety personnel (PSP), for example, correctional workers, dispatchers, firefighters, paramedics, and police officers, experience increased exposure to trauma and stress in their daily activities, which can affect their mental health and well-being [1,2].”
Higher-order model of resilience in the Canadian forces.
Lee, J. E. C., Sudom, K. A., & McCreary, D. R. (2011) · Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement · doi:10.1037/a0024473 · Cited by 61 · cited 1×
“…resilience in MMs have independently and not always cohesively explored the constructs of personality, positive affect, mastery, and social support [53]; neuroticism, military hardiness, and problem-solving coping [54]; and conscientiousness, emotional stability, and positive social interactions…”
van Gelderen, M. J., Nijdam, M. J., Haagen, J. F. G., & Vermetten, E. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000505977 · Cited by 59
Lopez, A. (2011) · WORK: A Journal of Prevention, Assessment & Rehabilitation · doi:10.3233/wor-2011-1102 · Cited by 56 · cited 5×
“According to Lopez [23], “resilient individuals have a greater likelihood of engaging in healthy and productive activities and having a better quality of life.””
InfluentialA Review of Free iPhone Applications Designed to Target Anxiety and Worry
Kertz, S. J., MacLaren Kelly, J., Stevens, K. T., Schrock, M., & Danitz, S. B. (2017) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-016-0006-y · Cited by 56 · cited 1×
“We included only free apps because evidence indicates that although 93% of smartphone users are likely to download an app, only 35.8% would be inclined to pay for an app [41].”
InfluentialVirtual Reality Applications to Address the Wounds of War
Rizzo, A., Buckwalter, J. G., Forbell, E., Reist, C., Difede, J., ROTHBAUM, B. O., Lange, B. S., Koenig, S. T., & Talbot, T. B. (2013) · Psychiatric Annals · doi:10.3928/00485713-20130306-08 · Cited by 49
Roy, M. J., Costanzo, M. E., Highland, K. B., Olsen, C., Clayborne, D., & Law, W. (2017) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2017.0221 · Cited by 43 · cited 5×
“The evidence-based literature demonstrated that many of the apps increased resilience strategies for users as well as improved the overall aspects of mental health [28,30,43,44].”
InfluentialBisson, J. I., van Deursen, R., Hannigan, B., Kitchiner, N., Barawi, K., Jones, K., Pickles, T., Skipper, J., Young, C., Abbott, L. R., et al. (2020) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13200 · Cited by 43
Designing smartphone mental health applications for emergency service workers
Deady, M., Peters, D., Lang, H., Calvo, R., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · Occupational Medicine · doi:10.1093/occmed/kqx056 · Cited by 40 · cited 2×
“A collaborative approach to development, using both expert and user input, has been noted in recent studies as an effective approach to increasing the success of apps [57,58,60].”
Occupational therapy and posttraumatic stress disorder: A scoping review
Edgelow, M. M., MacPherson, M. M., Arnaly, F., Tam-Seto, L., & Cramm, H. A. (2019) · Canadian Journal of Occupational Therapy · doi:10.1177/0008417419831438 · Cited by 36 · cited 4×
“…and skills listed in this model have been attributed to the fostering of resilience, including those used to improve emotional regulation and coping, such as mindfulness, grounding, and self-talk; positive affect, such as purposeful leisure activities; and interpersonal relationships [23,24].”
InfluentialAdvances in PTSD Treatment Delivery: the Role of Digital Technology in PTSD Treatment
Kuhn, E., & Owen, J. E. (2020) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-020-00207-x · Cited by 34 · cited 6×
“HCPs have a responsibility to advocate for best practices; this can be challenging with mHealth because of the high rate of app development and the inability for evidence-based practice to keep up [12,30,37].”
InfluentialConsensus on Use of the Term “App” Versus “Application” for Reporting of mHealth Research
Lewis, T. L., Boissaud-Cooke, M. A., Aungst, T. D., & Eysenbach, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3460 · Cited by 32 · cited 1×
“The latest estimates suggest that there are between 165,000 and 325,000 health and wellness apps currently available for download [10,11].”
Testing a Resilience Model Among Canadian Forces Recruits
Skomorovsky, A., & Stevens, S. (2013) · Military Medicine · doi:10.7205/milmed-d-12-00389 · Cited by 32 · cited 1×
“…in MMs have independently and not always cohesively explored the constructs of personality, positive affect, mastery, and social support [53]; neuroticism, military hardiness, and problem-solving coping [54]; and conscientiousness, emotional stability, and positive social interactions [55].”
Resilience interventions using interactive technology: a scoping review
Pusey, M., Wong, K. W., & Rappa, N. A. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2020.1772837 · Cited by 27 · cited 3×
“Earning rewards increased the attractiveness of the app, as did receiving guidance and instant feedback on target behaviors [26].”
Building resilience with the Stress Resilience Training System: Design validation and applications
de Visser, E. J., Dorfman, A., Chartrand, D., Lamon, J., Freedy, E., & Weltman, G. (2016) · Work · doi:10.3233/wor-162295 · Cited by 21
Precious, D., & Lindsay, A. E. (2018) · Journal of the Royal Army Medical Corps · doi:10.1136/jramc-2018-001047 · Cited by 21 · cited 2×
“This was further refined by Precious and Lindsay [22] with the Australian Armed Forces, resulting in a pillar of the mental resilience model (Figure 1 [21,22]).”
Infoway, C. H. (2016) · doi:10.18357/chi.2014.data02 · Cited by 19
Thomas, K. H., Taylor, S. P., Hamner, K., Glazer, J., & Kaufman, E. (2015) · Californian Journal of Health Promotion · doi:10.32398/cjhp.v13i2.1820 · Cited by 17 · cited 1×
“However, many users also noted a preference for more practical application opportunities of target skills, so their learned behaviors could be transferred to real-world concerns [52].”
Reyes, A. T., Serafica, R., & Sojobi, A. (2020) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2020.09.005 · Cited by 15 · cited 6×
“The evidence-based literature demonstrated that many of the apps increased resilience strategies for users as well as improved the overall aspects of mental health [28,30,43,44].”
InfluentialHealth Website Success: User Engagement in Health-Related Websites
Imlawi, J. (2017) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v11i6.6959 · Cited by 14 · cited 4×
“For example, some forms of technology, though widely used, may still not be available to everyone under all circumstances, for example, locations with unreliable or reduced cellular service, limited Wi-Fi access, and financial barriers may impede their use [37] .”
Influential(2015) · PubMed · Cited by 12
A scoping review of mental health mobile apps for use by the military community
Tam-Seto, L., Wood, V. M., Linden, B., & Stuart, H. (2018) · mHealth · doi:10.21037/mhealth.2018.12.01 · Cited by 11 · cited 3×
“When users complete treatment sessions, they have the ability to retain these tools for future use or reference to their care [30,50].”
Jones, C., O'Toole, K., Jones, K., & Brémault-Phillips, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/19807 · Cited by 11 · cited 5×
“…gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
InfluentialSelf-citationPerceptions of an AI-Supported Mobile App for Military Health in the Canadian Armed Forces
Tam-Seto, L., Wood, V. M., Linden, B., & Stuart, H. (2021) · Military Behavioral Health · doi:10.1080/21635781.2020.1838364 · Cited by 11 · cited 2×
“…with other app evaluation tools, such as the Mobile App Rating Scale, may allow for a more in-depth understanding of mHealth apps; however, for the MMs and PSP populations, the ARIA’s additional security and privacy questions provide a clearer understanding of population-specific concerns [7,44].”
Evaluating the quality of resilience apps for military members and public safety personnel
O’Toole, K., & Brown, C. A. (2021) · Journal of Military, Veteran and Family Health · doi:10.3138/jmvfh-2020-0002 · Cited by 8 · cited 10×
“HCPs have a responsibility to advocate for best practices; this can be challenging with mHealth because of the high rate of app development and the inability for evidence-based practice to keep up [12,30,37].”
InfluentialAlberta Rating Index for Apps (ARIA): Helping older adults find acceptable mobile health apps
Azad-Khaneghah, P., Roduta Roberts, M., Stroulia, E., Ferguson-Pell, M., & Liu, L. (2020) · Gerontechnology · doi:10.4017/gt.2020.19.s.69884 · Cited by 3 · cited 3×
“The eQuoo app was demonstrated to significantly improve the traits of resilience, personal growth, and positive relationships [40].”
Influential
Research works printed but not linked: 2
- Roy, M, 2015, Stud Health Technol Inform, 219, 123
- 10.3316/informit.553541068174068 · doi:10.3316/informit.553541068174068
Cited by
Wang, X., Xie, N., Zhang, H., Zhou, W., & Lei, J. (2025) · Inflammation · doi:10.1007/s10753-025-02289-2 · Cited by 78
“ISO has also been shown to protect against cell death by inhibiting caspase-dependent pathways [44].”
Thanthrige, A. N. W., Lu, B., Sako, Z. Z., & Wickramasinghe, N. S. (2025) · Journal of Medical Internet Research · doi:10.2196/64524 · Cited by 59
Moghimi, E., Knyahnytska, Y., Omrani, M., Nikjoo, N., Stephenson, C., Layzell, G., Simpson, A. I. F., & Alavi, N. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.921527 · Cited by 29
How to Design and Evaluate mHealth Apps? A Case Study of a Mobile Personal Health Record App
Kim, G., Hwang, D., Park, J., Kim, H. K., & Hwang, E.-S. (2024) · Electronics · doi:10.3390/electronics13010213 · Cited by 20
“Examples include a study considering the elderly [34], a study in a diverse, low-income patient population [35], and a study specializing in mental health [36].”
BackgroundThe telehealth program of occupational therapy among older people: an up-to-date scoping review
Ding, J., Yang, Y., Wu, X. J., Xiao, B., Ma, L., & Xu, Y. (2022) · Aging Clinical and Experimental Research · doi:10.1007/s40520-022-02291-w · Cited by 19
Metadata
- Authors
- Voth, M., Chisholm, S., Sollid, H., Jones, C., Smith-MacDonald, L., & Brémault-Phillips, S.
- Affiliations
- University of Alberta (CA)
- Leiden University (NL)
- Corresponding author
- Jones, Chelsea
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2022-01-19
- Volume
- 10
- Issue
- 1
- Pages
- e26453
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC8811698
- OpenAlex
- W3215045341
- Cited by
- 35
- References
- 52
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 7 · 2023: 5 · 2022: 4
- FWCI
- 0.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Clinical Psychology › Resilience and Mental Health
- Keywords
- mobile health apps, military personnel, veterans, public safety personnel, app quality assessment, free apps, psychoeducation, mindfulness, cognitive behavioral therapy, acceptance and commitment therapy, mental health interventions, suicide prevention
- MeSH terms
- Alberta, Humans, Veterans, Telemedicine, Mobile Applications, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.