The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index; 20 of the 36 sources its claims cite were checked for support.
Apps with maps-anxiety and depression mobile apps with evidence-based frameworks: Systematic search of major app stores
Open accessPublished version of a preprint
Abstract
Background: Mobile mental health apps have become ubiquitous tools to assist people in managing symptoms of anxiety and depression. However, due to the lack of research and expert input that has accompanied the development of most apps, concerns have been raised by clinicians, researchers, and government authorities about their efficacy. Objective: This review aimed to estimate the proportion of mental health apps offering comprehensive therapeutic treatments for anxiety and/or depression available in the app stores that have been developed using evidence-based frameworks. It also aimed to estimate the proportions of specific frameworks being used in an effort to understand which frameworks are having the most influence on app developers in this area. Methods: A systematic review of the Apple App Store and Google Play store was performed to identify apps offering comprehensive therapeutic interventions that targeted anxiety and/or depression. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist was adapted to guide this approach. Results: Of the 293 apps shortlisted as offering a therapeutic treatment for anxiety and/or depression, 162 (55.3%) mentioned an evidence-based framework in their app store descriptions. Of the 293 apps, 88 (30.0%) claimed to use cognitive behavioral therapy techniques, 46 (15.7%) claimed to use mindfulness, 27 (9.2%) claimed to use positive psychology, 10 (3.4%) claimed to use dialectical behavior therapy, 5 (1.7%) claimed to use acceptance and commitment therapy, and 20 (6.8%) claimed to use other techniques. Of the 162 apps that claimed to use a theoretical framework, only 10 (6.2%) had published evidence for their efficacy. Conclusions: The current proportion of apps developed using evidence-based frameworks is unacceptably low, and those without tested frameworks may be ineffective, or worse, pose a risk of harm to users. Future research should establish what other factors work in conjunction with evidence-based frameworks to produce efficacious mental health apps. © Jamie M Marshall, Debra A Dunstan, Warren Bartik. Originally published in JMIR Mental Health (http://mental.jmir.org),24.06.2020. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.
Overview
CoChat Summary
## TL;DR
This systematic search of the Apple App Store and Google Play found 293 apps that appeared to offer therapeutic treatment for anxiety and/or depression, but only 162 (55.3%) mentioned an evidence-based framework in their descriptions. Of those 162, only 10 (6.2%) had published evidence for efficacy.
## Key findings
- The search identified 293 apps whose descriptions inferred a therapeutic treatment for anxiety and/or depression; 162/293 (55.3%) said they used an evidence-based theoretical framework.
- Among all 293 apps, the most commonly claimed frameworks were CBT 88/293 (30.0%), mindfulness 46/293 (15.7%), positive psychology 27/293 (9.2%), DBT 10/293 (3.4%), ACT 5/293 (1.7%), and other techniques 20/293 (6.8%).
- Restricting to the 162 apps that claimed a theoretical framework, CBT made up 54.3% (88/162), followed by mindfulness 28.4% (46/162) and positive psychology 16.7% (27/162).
- Only 10/162 (6.2%) apps with a claimed framework had published evidence for effectiveness; across those studies there were 1017 participants in intervention conditions and 447 in control groups, with a mean age of 32.7 years (SD 9.3) where reported.
## Methods
- The authors conducted a systematic review/search of the Apple App Store and Google Play Store, using an adapted PRISMA/AMSTAR-based protocol called PASSR.
- Searches were run by four researchers in December 2018 and again in July 2019 using 19 keywords across all categories; apps were counted once even if available in both stores.
- Inclusion was limited to English-language apps whose descriptions indicated a comprehensive therapeutic treatment for anxiety and/or depression rather than only a single element of therapy; analysis was based on app store descriptions.
## Limitations
- The paper states that app store searching has restricted search capabilities, results can be influenced by developer-completed questionnaires and store algorithms, and app ordering can be ambiguous compared with literature searches.
- A stated limitation is that the study was based on app store descriptions only; none of the shortlisted apps were trialed to verify that descriptions matched actual content.
- Evident from the text: the review may miss apps whose descriptions did not clearly signal treatment for anxiety/depression, and it does not assess the quality of the claimed frameworks or whether apps were actually available/downloadable to all users despite being listed.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
12 Valid · 1 Not valid · 9 Not checked · 46 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Over the last two decades, e-mental health programs with a CBT framework and designed for use on computers have been found to be effective for both adults and children in reducing anxiety and depression [19,20]”
§ Apps With Maps—Anxiety and Depression Mobile Apps With Evidence-Based Frameworks: Systematic Search of Major App Stores > Introduction > Apps and Evidence-Based Frameworks
What the sources say
- Supportedcites [19] source
The Introduction states that computer- and Internet-based CBT is effective for depressive and anxiety disorders in adults. The Discussion reports significant effects on anxiety and depressive symptoms in youth, supporting the claim for both age groups. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [20] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The nine research articles [47-55] that examined the 10 apps were made up of seven randomized controlled trials (RCTs)—the Flett et al article contained one RCT with 2 of the listed apps: Headspace and Smiling Mind [52]—and two feasibility or pilot studies: Kinderman et al [48] and Carey et al [55].”
§ Apps With Maps—Anxiety and Depression Mobile Apps With Evidence-Based Frameworks: Systematic Search of Major App Stores > Results
What the sources say
- Supportedcites [47] source
This paper supports its role as one of the cited randomized controlled trials examining two apps, not the aggregate count across all nine articles. The Discussion > Limitations calls it an RCT directly comparing an agoraphobia-specific app with a generic anxiety-related app, and Methods > Sample Size names the two apps as Agoraphobia Free and Stress Free. (LLM, conf=0.91)
- Supportedcites [48] source
The citation to Kinderman et al. [48] identifies it as one of the feasibility or pilot studies, rather than as support for the count of nine articles. Its Abstract (Aims) describes the first trial of Catch It, and its Discussion says a randomized controlled trial should be the next step. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [49] source
- Not checked — no full text of the sourcecites [50] source
- Partly supportedcites [51] sourceExperimental — accuracy not yet measured
The Method > Treatments passage describes a randomized comparison involving two apps, and the Discussion calls this a pilot trial. The paper does not establish the citing sentence’s totals of nine articles and ten apps, its seven-RCT/two-pilot classification, or the named studies’ places in that classification (pages unavailable in our copy). (LLM, conf=0.77)
- Not checked — no full text of the sourcecites [52] source
- Supportedcites [53] source
This paper supports its inclusion as one of the cited randomized trials. The Procedure section (page unavailable) says participants were randomized to DeStressify or a wait-list control, and the Design section calls it a pilot, exploratory study. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [54] source
- Supportedcites [55] source
Carey et al. identify their research as a pilot study in the Discussion (page unavailable). That supports the part of the citing sentence for which Carey et al. [55] is cited: its classification as a pilot study. The source is not being cited to establish the counts across all nine articles. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“over 90% of available apps for depression can be found in either of these stores [46].”
§ Apps With Maps—Anxiety and Depression Mobile Apps With Evidence-Based Frameworks: Systematic Search of Major App Stores > Methods
What the sources say
- Supportedcites [46] source
The Results > General Characteristics section reports that Google accounted for 53.5% and Apple for 37.0% of the 243 included depression apps. Together, that is 90.5%, supporting the claim for the apps identified in this study’s five-store search. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“and improving happiness and well-being [21-23].”
§ Apps With Maps—Anxiety and Depression Mobile Apps With Evidence-Based Frameworks: Systematic Search of Major App Stores > Introduction > Apps and Evidence-Based Frameworks
What the sources say
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
The Results (Intervention Characteristics) include programs aimed at general psychological well-being, and the Discussion (Conclusions) cautiously supports the effectiveness of Internet-delivered CBT for university students’ mental-health outcomes. The paper does not report an improvement in happiness specifically, and its demonstrated benefits chiefly concern depression, anxiety, and stress rather than a measured overall well-being outcome. (LLM, conf=0.85)
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
The Discussion’s Principal Findings (page unavailable) report improved well-being scores among young people using the web-based Bite Back program. But the Methods identify Bite Back as a positive psychology program, not one with a CBT framework, and the paper does not report a separate measure of happiness. (LLM, conf=0.87)
- Partly supportedcites [23] sourceExperimental — accuracy not yet measured
The Methods (Intervention) describe MoodGYM as an Internet-based program teaching cognitive-behavioral skills, and the Results report significantly higher mental well-being scores than the control group at 6 and 12 weeks. The Methods (Outcome Measures) identify mental well-being as the primary outcome, but the paper does not report a separate measure or finding for happiness. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Some studies have compared the effectiveness of e-mental health programs with face-to-face therapy and have found comparable [24,25]”
§ Apps With Maps—Anxiety and Depression Mobile Apps With Evidence-Based Frameworks: Systematic Search of Major App Stores > Introduction > Apps and Evidence-Based Frameworks
What the sources say
- Supportedcites [24] source
The Results report five studies comparing computerized CBT with face-to-face CBT for depression or panic disorder. The difference between treatments was not statistically significant, supporting the claim that the programs were found comparable in those studies. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [25] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
33 more claims
Create a free account to see all 68 claims and every source verdict.
- It may state two separate claims as one. 17
- Probably not a substantial claim. 19
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mental health apps that saw a surge in downloads during the COVID-19 pandemic (eg, Headspace, Calm, Talkspace, Teladoc's BetterHelp, and Noom) have since experienced declining downloads.”
From Digital health technologies and major depressive disorder (2023) · cites this paper as [152]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 3×
“ACT: acceptance and commitment therapy AMSTAR: A MeaSurement Tool to Assess systematic Reviews CBT: cognitive behavioral therapy DBT: dialectical behavior therapy IPT: interpersonal therapy mHealth: mobile health PASSR: Protocol for App Store Systematic Reviews PRISMA: Preferred Reporting Items for Systematic Reviews…”
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Positive psychology: An introduction.
Seligman, M. E. P., & Csikszentmihalyi, M. (2000) · American Psychologist · doi:10.1037/0003-066x.55.1.5 · Cited by 11,351
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 1×
“This systematic review used the AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2 [43] and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) [44] protocols for guidance in conducting the app store search.”
MethodPositive Psychology Progress: Empirical Validation of Interventions.
Seligman, M. E. P., Steen, T. A., Park, N., & Peterson, C. (2005) · American Psychologist · doi:10.1037/0003-066x.60.5.410 · Cited by 5,947 · cited 1×
“For example, Freedman and Enright [33] showed that forgiveness significantly decreased depression, Froh et al [34] implemented a gratitude intervention that resulted in significantly greater optimism and life satisfaction as well as decreased negative affect, Lyubomirsky et al [35] reported an increase in happiness an…”
MethodCognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
The effect of mindfulness based therapy on anxiety and depression: A meta analytic review
Hofmann, S. G., Sawyer, A. T., Witt, A. A., & Oh, D. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018555 · Cited by 3,846 · cited 1×
“Various mindfulness interventions have proved efficacious in the past [38], and these meditation and breathing activities are easily incorporated into an app.”
Background
Research works printed but not linked: 1
- SmithAPew Research Center201504012019-01-20Washington, DCPew Internet & American Life ProjectChapter one: A portrait of smartphone ownershiphttp://www.pewinternet.org/2015/04/01/chapter-one-a-portrait-of-smartphone-ownership/
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Rauschenberg, C., Schick, A., Goetzl, C., Roehr, S., Riedel-Heller, S. G., Koppe, G., Durstewitz, D., Krumm, S., & Reininghaus, U. (2021) · European Psychiatry · doi:10.1192/j.eurpsy.2021.17 · Cited by 158
A review of mobile chatbot apps for anxiety and depression and their self-care features
Ahmed, A., Ali, N., Aziz, S., Abd-alrazaq, A. A., Hassan, A., Khalifa, M., Elhusein, B., Ahmed, M., Ahmed, M. A. S., & Househ, M. (2021) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2021.100012 · Cited by 112
Esophageal Hypervigilance and Symptom-Specific Anxiety in Patients with Eosinophilic Esophagitis
Taft, T., Carlson, D. A., Simons, M. L., Zavala, S., Hirano, I., Gonsalves, N. P., & Pandolfino, J. E. (2021) · Gastroenterology · doi:10.1053/j.gastro.2021.06.023 · Cited by 101
Götzl, C., Hiller, S., Rauschenberg, C., Schick, A., Fechtelpeter, J., Fischer-Abaigar, U., Koppe, G., Durstewitz, D., Reininghaus, U., & Krumm, S. (2022) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-022-00522-6 · Cited by 105
“Existing apps available in major app stores rarely use evidence–based frameworks [16–19], frequently do not involve young people in the development [20], and therefore often remain insufficiently tailored to the needs of young users [4, 20, 21].”
Background
Metadata
- Authors
- Marshall, J. M., Dunstan, D. A., & Bartik, W.
- Affiliations
- University of New England (AU)
- Corresponding author
- Marshall, Jamie M
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-06-24
- Volume
- 7
- Issue
- 6
- Pages
- e16525
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7381031
- OpenAlex
- W3037015118
- Cited by
- 83
- References
- 65
- Citations by year
- 2026: 7 · 2025: 9 · 2024: 18 · 2023: 11 · 2022: 18 · 2021: 18 · 2020: 2
- FWCI
- 11.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RUNE (Research UNE) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- mental health apps, anxiety, depression, evidence-based framework, cognitive behavioral therapy, mindfulness, positive psychology, dialectical behavior therapy, acceptance and commitment therapy, app efficacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Apps with maps-anxiety and depression mobile apps with evidence-based frameworks: Systematic search of major app stores. https://app.cochat.ai/papers/10.2196/16525
- The paper
- Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020). Apps with maps-anxiety and depression mobile apps with evidence-based frameworks: Systematic search of major app stores. JMIR Mental Health. https://doi.org/10.2196/16525
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.