Quality of Psychoeducational Apps for Military Members With Mild Traumatic Brain Injury: An Evaluation Utilizing the Mobile Application Rating Scale
Open accessPublished version of a preprint
Abstract
Background: Military personnel have an elevated risk of sustaining mild traumatic brain injuries (mTBI) and postconcussion symptoms (PCS). Smartphone apps that provide psychoeducation may assist those with mTBI or PCS to overcome unique barriers that military personnel experience with stigma and access to health care resources. Objective: This study aims to (1) use the Mobile Application Rating Scale (MARS) to evaluate smartphone apps purporting to provide psychoeducation for those who have sustained an mTBI or a PCS; (2) explore the relevance, utility, and effectiveness of these apps in facilitating symptom management and overall recovery from mTBI and PCS among military personnel; and (3) discuss considerations pertinent to health care professionals and patients with mTBI when considering the use of mobile health (mHealth), including apps for mTBI psychoeducation. Methods: A five-step systematic search for smartphone apps for military members with mTBI or PCS was conducted on January 31, 2020. Cost-free apps meeting the inclusion criteria were evaluated using the MARS and compared with evidence-based best practice management protocols for mTBI and PCS. Results: The search yielded a total of 347 smartphone apps. After applying the inclusion and exclusion criteria, 13 apps were subjected to evaluation. Two apps were endorsed by the US Department of Veterans Affairs and the US Department of Defense; all the others (n=11) were developed for civilians. When compared with evidence-based best practice resources, the apps provided various levels of psychoeducational content. There are multiple considerations that health care professionals and those who sustain an mTBI or a PCS have to consider when choosing to use mHealth and selecting a specific app for mTBI psychoeducation. These may include factors such as the app platform, developer, internet requirement, cost, frequency of updates, language, additional features, acknowledgment of mental health, accessibility, military specificity, and privacy and security of data. Conclusions: Psychoeducational interventions have a good evidence base as a treatment for mTBI and PCS. The use of apps for this purpose may be clinically effective, cost-effective, confidential, user friendly, and accessible. However, more research is needed to explore the effectiveness, usability, safety, security, and accessibility of apps designed for mTBI management.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
mHealth apps may fill a gap for those who require mental health treatment but face barriers such as stigma to visible help-seeking, long waiting times, high job mobility, and geographic restrictions.
“In addition, mHealth apps may fill a gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
From Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation (2022) · cites this paper as [8]
The Introduction’s Background section says apps may decrease stigma, reduce wait times, and offer mental health support to military members and veterans concerned about stigmatization. The Conclusions also identify geographical isolation as a barrier apps may help address. The paper does not identify high job mobility as a barrier, so that part of the attributed claim is unsupported. (LLM, conf=0.85)
Experimental — accuracy not yet measuredThe lack of empirical research to demonstrate the effectiveness of apps on resilience may be related to the short time frame during which mHealth apps have emerged and the speed at which their availability changes.
“The lack of empirical research to demonstrate the effectiveness of apps on resilience may be related to the short time frame during which mHealth apps have emerged and the speed at which their availability changes [8].”
From Efficacy, Effectiveness, and Quality of Resilience-Building Mobile Health Apps for Military, Veteran, and Public Safety Personnel Populations: Scoping Literature Review and App Evaluation (2022) · cites this paper as [8]
The Discussion’s ‘Health Care Use and Future Direction’ section (page not provided) suggests that limited effectiveness research may reflect how recently mHealth apps emerged and how quickly their availability changes. That finding concerns psychoeducational and mTBI-management apps; the passage does not address apps for resilience. (LLM, conf=0.88)
Experimental — accuracy not yet measuredTraditional study design and research methods may be inappropriate for the study of mHealth as technology evolves much faster than traditional evidence-based research.
“traditional study design and research methods may be inappropriate for the study of mHealth as technology evolves much faster than traditional evidence-based research [8,60].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ASSESSMENT OF COMA AND IMPAIRED CONSCIOUSNESS
Teasdale, G., & Jennett, B. (1974) · The Lancet · doi:10.1016/s0140-6736(74)91639-0 · Cited by 13,215 · see citing works
McCrory, P., Meeuwisse, W., Dvorak, J., Aubry, M., Bailes, J., Broglio, S., Cantu, R. C., Cassidy, D., Echemendia, R. J., Castellani, R. J., et al. (2017) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-097699 · Cited by 3,568 · see citing works
Mild traumatic brain injury in U.S. soldiers returning from Iraq
Hoge, C. W., McGurk, D., Thomas, J. L., Cox, A. L., Engel, C. C., & Castro, C. A. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa072972 · Cited by 2,775 · see citing works
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · see citing works
McCrory, P. R., Meeuwisse, W. H., Aubry, M., Cantu, B., Dvořák, J., Echemendía, R. J., Engebretsen, L., Johnston, K., Kutcher, J., Raftery, M., et al. (2013) · Physical Therapy in Sport · doi:10.1016/j.ptsp.2013.03.002 · Cited by 2,133 · see citing works
Persistent postconcussion syndrome
Cicerone, K. D., & Kalmar, K. (1995) · Journal of Head Trauma Rehabilitation · doi:10.1097/00001199-199510030-00002 · Cited by 753 · see citing works
McCrory, P. R., Meeuwisse, W. H., Johnston, K., Dvořák, J., Aubry, M., Molloy, M., & Cantu, R. C. (2009) · Journal of Athletic Training · doi:10.4085/1062-6050-44.4.434 · Cited by 696 · see citing works
Huckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376 · see citing works
A Content Analysis of Popular Smartphone Apps for Smoking Cessation
Abroms, L. C., Westmaas, J. L., Bontemps-Jones, J. E., Ramani, R., & Mellerson, J. L. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.07.008 · Cited by 325 · see citing works
Medical apps for smartphones: lack of evidence undermines quality and safety
Buijink, A. W. G., Visser, B. J., & Marshall, L. (2013) · Evidence Based Medicine · doi:10.1136/eb-2012-100885 · Cited by 303 · see citing works
Marshall, S., Bayley, M., McCullagh, S., Velikonja, D., Berrigan, L., Ouchterlony, D., & Weegar, K. (2015) · Brain Injury · doi:10.3109/02699052.2015.1004755 · Cited by 263 · see citing works
Physical Therapy Evaluation and Treatment After Concussion/Mild Traumatic Brain Injury
Quatman‐Yates, C. C., Hunter-Giordano, A. O., Shimamura, K. K., Landel, R., Alsalaheen, B. A., Hanke, T. A., McCulloch, K. L., Altman, R. D., Beattie, P., Berz, K. E., et al. (2020) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2020.0301 · Cited by 173 · see citing works
Colorectal smartphone apps: opportunities and risks
O’Neill, S., & Brady, R. R. W. (2012) · Colorectal Disease · doi:10.1111/j.1463-1318.2012.03088.x · Cited by 165 · see citing works
Blast-Related Traumatic Brain Injury: Current Concepts and Research Considerations
Bryden, D. W., Tilghman, J. I., & Hinds, S. R. (2019) · Journal of Experimental Neuroscience · doi:10.1177/1179069519872213 · Cited by 143 · see citing works
Cooper, D. B., Bunner, A. E., Kennedy, J. E., Balldin, V. H., Tate, D. F., Eapen, B. C., & Jaramillo, C. A. (2015) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9440-2 · Cited by 136 · see citing works
Improving App Privacy: Nudging App Developers to Protect User Privacy
Balebako, R., & Cranor, L. F. (2014) · IEEE Security & Privacy · doi:10.1109/msp.2014.70 · Cited by 113 · see citing works
Epidemiology and prognosis of mild traumatic brain injury in returning soldiers
Schwab, K. A., Terrio, H. P., Brenner, L. A., Pazdan, R. M., McMillan, H. P., MacDonald, M., Hinds, S. R., & Scher, I. (2017) · Neurology · doi:10.1212/wnl.0000000000003839 · Cited by 96 · see citing works
Mild Traumatic Brain Injury in UK Military Personnel Returning From Afghanistan and Iraq
Rona, R. J., Jones, M., Fear, N. T., Hull, L., Murphy, D., Machell, L., Coker, B., Iversen, A. C., Jones, N., David, A. S., et al. (2011) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e318212f814 · Cited by 95 · see citing works
Unique Aspects of Traumatic Brain Injury in Military and Veteran Populations
Armistead-Jehle, P., Soble, J. R., Cooper, D. B., & Belanger, H. G. (2017) · Physical Medicine and Rehabilitation Clinics of North America · doi:10.1016/j.pmr.2016.12.008 · Cited by 77 · see citing works
Janak, J. C., Cooper, D. B., Bowles, A. O., Alamgir, A. H., Cooper, S. P., Gabriel, K. P., Pérez, A., & Orman, J. A. (2015) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000202 · Cited by 64 · see citing works
Wyatt, J. C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1211-7 · Cited by 61 · see citing works
Kutcher, J. S., McCrory, P. R., Davis, G. A., Ptito, A., Meeuwisse, W. H., & Broglio, S. P. (2013) · British Journal of Sports Medicine · doi:10.1136/bjsports-2013-092257 · Cited by 60 · see citing works
Garber, B. G., Rusu, C., & Zamorski, M. A. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0325-5 · Cited by 59 · see citing works
Low Vision Rehabilitation: A Practical Guide for Occupational Therapists
Scheiman, M. M., Scheiman, M., Whittaker, S. R., Barackman, P. F., & Sokol-McKay, D. A. (2006) · Medical Entomology and Zoology · Cited by 58 · see citing works
Lee, H., Sullivan, S. J., Schneiders, A. G., Ahmed, O. H., Balasundaram, A. P., Williams, D. D., Meeuwisse, W. H., & McCrory, P. R. (2014) · British Journal of Sports Medicine · doi:10.1136/bjsports-2013-092930 · Cited by 54 · see citing works
Persistent postconcussion syndrome
Cicerone, K. D., & Kalmar, K. (1995) · Journal of Head Trauma Rehabilitation · doi:10.1097/00001199-199506000-00002 · Cited by 34 · see citing works
Consensus on Use of the Term “App” Versus “Application” for Reporting of mHealth Research
Lewis, T. L., Boissaud-Cooke, M. A., Aungst, T. D., & Eysenbach, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3460 · Cited by 32 · see citing works
Occupational Therapy for Service Members With Mild Traumatic Brain Injury
Radomski, M. V., Davidson, L., Voydetich, D. J., & Erickson, M. W. (2009) · American Journal of Occupational Therapy · doi:10.5014/ajot.63.5.646 · Cited by 31 · see citing works
Rhea, C. K., Kuznetsov, N. A., Ross, S. E., Long, B. L., Jakiela, J. T., Bailie, J. M., Yanagi, M. A., Haran, F. J., Wright, W. G., Robins, R. K., et al. (2017) · Military Medicine · doi:10.7205/milmed-d-16-00140 · Cited by 29 · see citing works
Garber, B. G., Rusu, C., Zamorski, M. A., & Boulos, D. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010780 · Cited by 14 · see citing works
Kwan, V., Bihelek, N., Anderson, V. A., & Yeates, K. O. (2018) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000425 · Cited by 14 · see citing works
A scoping review of mental health mobile apps for use by the military community
Tam-Seto, L., Wood, V. M., Linden, B., & Stuart, H. (2018) · mHealth · doi:10.21037/mhealth.2018.12.01 · Cited by 11 · see citing works
Stec, M. A., & Arbour, M. W. (2020) · Advances in Family Practice Nursing · doi:10.1016/j.yfpn.2020.01.003 · Cited by 11 · see citing works
Eghdam, A., Bartfai, A., Oldenburg, C., & Koch, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159362 · Cited by 9 · see citing works
Mild traumatic brain injury in military service personnel: key issues and considerations
Doneva, S. P. (2018) · Journal of Military Veteran and Family Health · doi:10.3138/jmvfh.2017-0012 · Cited by 6 · see citing works
Jones, C., Pike, A., & Brémault‐Phillips, S. (2019) · Journal of Military Veteran and Family Health · doi:10.3138/jmvfh.2018-0005 · Cited by 5 · see citing works
Self-citationConcussion: Physical Therapy Treatment After Mild Traumatic Brain Injury
(2020) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2020.0503 · Cited by 3 · see citing works
Book Review: Low Vision Rehabilitation: A Practical Guide for Occupational Therapists
Crowle, C. (2010) · British Journal of Visual Impairment · doi:10.1177/0264619609349434 · Cited by 1 · see citing works
FDA-Approved Devices Assess Cognition After Possible Brain Injury in Youth
Moran, M. (2016) · Psychiatric News · doi:10.1176/appi.pn.2016.10b2 · Cited by 1 · see citing works
Not So Fast, Federal Regulators Warn. There Is No Approved Device to Diagnose Concussion on the Spot
FitzGerald, S. F. (2019) · Neurology Today · doi:10.1097/01.nt.0000559865.92231.19 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [8]Marshall S Bayley M McCullagh S Berrigan L Fischer L Ouchterlony D Rockwell C Velikonja D Guidelines for Concussion /Mild Traumatic Brain Injury and Prolonged Symptoms Ontario Neurotrauma Foundation 2018 2020-04-01 https://onf.org/3rd-edition-guidelines-for-concussion-mild-traumatic-brain-injury-and-persistent-symptoms/
- [42]Owings-Fonner N A Review of Meditation Apps for Adults. Let's Get Technical: A Review of the Latest Apps and Tools for Practicing Psychologists American Psychological Assocaition 2019 2020-05-09 https://www.apaservices.org/practice/business/technology/tech-column/apps-tools-psychologists
Cited by
Sorted by citations
Understanding the evaluation of mHealth app features based on a cross-country Kano analysis
Gimpel, H., Manner-Romberg, T., Schmied, F., & Winkler, T. J. (2021) · Electronic Markets · doi:10.1007/s12525-020-00455-y · Cited by 46 · see citing works
Voth, M., Chisholm, S., Sollid, H., Jones, C., Smith-MacDonald, L., & Brémault-Phillips, S. (2022) · JMIR mHealth and uHealth · doi:10.2196/26453 · Cited by 35 · see citing works
“…gap for those who require mental health treatment but are faced with barriers, such as stigma to visible help-seeking, long waiting times, a high mobility of their jobs, and geographic restrictions [8,30,33,34], all of which have been noted as problematic for the MMs, PSP, and veteran populations.”
InfluentialSelf-citationWoulfe, F., Fadahunsi, K. P., Smith, S. D., Chirambo, G. B., Larsson, E. E. C., Henn, P., Mawkin, M., & Donoghue, J. O. (2021) · JMIR mhealth and uhealth · doi:10.2196/28384 · Cited by 30 · see citing works
McDarby, M., Llaneza, D. H., George, L. S., & Kozlov, E. (2020) · American Journal of Hospice and Palliative Medicine® · doi:10.1177/1049909120959057 · Cited by 20 · see citing works
Jones, C., Miguel Cruz, A., Smith-MacDonald, L., Brown, M. R. G., Vermetten, E., & Brémault-Phillips, S. (2022) · JMIR Formative Research · doi:10.2196/33681 · Cited by 19 · see citing works
Self-citationHeart Rate Variability Biofeedback for Mild Traumatic Brain Injury: A Randomized-Controlled Study
Lu, H. C., Gevirtz, R., Yang, C. C., & Hauson, A. O. (2023) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-023-09592-4 · Cited by 18 · see citing works
Downing, M. G., Hicks, A. J., Braaf, S., Myles, D., Gabbe, B. J., & Ponsford, J. L. (2021) · Disability and Rehabilitation · doi:10.1080/09638288.2021.1992517 · Cited by 11 · see citing works
Jones, C., Cruz, A. M., & Brémault‐Phillips, S. (2021) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/26078 · Cited by 15 · see citing works
Self-citationDigitized thought records: a practitioner-focused review of cognitive restructuring apps
Erhardt, D., Bunyi, J., Dodge-Rice, Z., Neary, M., & Schueller, S. M. (2022) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x22000320 · Cited by 10 · see citing works
Neuropsychiatric Treatment for Mild Traumatic Brain Injury: Nonpharmacological Approaches
Mollica, A., Dey, A., Cairncross, M., Silverberg, N. D., & Burke, M. J. (2022) · Seminars in Neurology · doi:10.1055/s-0041-1742143 · Cited by 10 · see citing works
Evaluating mobile mental health apps using the mobile application rating scale (MARS) in the U.S.
Ki, E., Jang, J., & Kang, D.-Y. (2024) · Advances in Mental Health · doi:10.1080/18387357.2024.2388680 · Cited by 7 · see citing works
- Authors
- Jones, C., O'Toole, K., Jones, K., & Brémault-Phillips, S.
- Affiliations
- Department of National Defence (CA)
- Corresponding author
- Jones, Chelsea
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-18
- Volume
- 8
- Issue
- 8
- Pages
- e19807
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC7463411
- OpenAlex
- W3043789087
- Cited by
- 11
- References
- 39
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 3 · 2021: 5 · 2020: 1
- FWCI
- 1.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Epidemiology › Traumatic Brain Injury Research
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- mild traumatic brain injury, post-concussion symptoms, psychoeducation, mobile application, mobile health, military personnel, app quality assessment, Mobile App Rating Scale, symptom management, barriers to care, data privacy and security
- MeSH terms
- Brain Concussion, Humans, Mental Health, Military Personnel, United States, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review