The DOI matches its Crossref record; 72 of the 74 references it cites were found in a registry or an index; none of the 29 sources its claims cite is checked for support yet.
A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Open accessAbstract
Depression is a common mental health condition for which many mobile apps aim to provide support. This review aims to identify self-help apps available exclusively for people with depression and evaluate those that offer cognitive behavioural therapy (CBT) or behavioural activation (BA). One hundred and seventeen apps have been identified after searching both the scientific literature and the commercial market. 10.26% (n = 12) of these apps identified through our search offer support that seems to be consistent with evidence-based principles of CBT or BA. Taking into account the non existence of effectiveness/efficacy studies, and the low level of adherence to the core ingredients of the CBT/BA models, the utility of these CBT/BA apps are questionable. The usability of reviewed apps is highly variable and they rarely are accompanied by explicit privacy or safety policies. Despite the growing public demand, there is a concerning lack of appropiate CBT or BA apps, especially from a clinical and legal point of view. The application of superior scientific, technological, and legal knowledge is needed to improve the development, testing, and accessibility of apps for people with depression.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review identified 117 depression self-help apps, but only 12 (10.26%) appeared consistent with CBT or BA principles. The authors conclude that these CBT/BA apps have no published efficacy/effectiveness evidence, low fidelity to core CBT/BA ingredients, variable usability, and rarely include privacy or safety policies.
Key findings
- Of 117 apps, 12 (10.26%) were classified as CBT/BA; no studies reported in the scientific literature determined benefits for any of these CBT/BA apps.
- Median adherence to CBT principles was 15% (range 0–75%) and to BA principles was 18.75% (range 6.25–25%); the best CBT apps were Depression CBT Self-Help Guide (75%) and eCBT Mood (55%).
- Usability heuristic adherence had a median of 83% (range 42–98%); highest scorers were MoodTools–Depression Aid (98%), Activity Diary (98%), and Depression Cure–The Free 12 Week Course (92%).
- Only eCBT Mood and Depression CBT Self-Help Guide offered a privacy policy, and 5 of 12 apps (41.66%) provided safety information during crisis; no relationship was found between CBT/BA adherence and usability or popularity indicators.
Methods
- Systematic review searching scientific databases (IEEE, ACM Digital Library, EMBASE, PubMed/Medline, PsychINFO, Web of Science) in November 2015 and the Canadian Apple App Store and Android Market/Google Play in November 2015 using “depression”; inclusion required native smartphone apps exclusively for depression, publicly available in Canada in December 2015, and in English.
- Two reviewers screened and categorized apps with Cohen’s kappa reported at 0.69, 0.85, 0.92, and 0.89 across stages; CBT/BA apps were downloaded and evaluated on usefulness (expert-rated fidelity to CBT/BA core ingredients on a 0–2 scale and literature-based effectiveness), usability (Nielsen heuristics rated 1–5), and integration/infrastructure (privacy policy and safety).
- Analysis used counts and percentages plus Spearman correlations between CBT/BA adherence, usability adherence, and popularity/acceptability indicators.
Limitations
- Stated: the review was limited to English downloadable apps in Canada and only the two most popular platforms; apps on less prevalent platforms, in other languages/countries, or developed and tested in academic settings were excluded.
- Stated: CBT/BA app evaluation was based on one expert’s opinion, and an expert panel could have increased credibility; lack of common constructs, outcome measures, definitions, and standards for other app types made cross-case comparison impossible.
- Evident from the text: the included CBT/BA apps had no published efficacy/effectiveness studies, the CBT/BA sample was only 12 apps, and usability, privacy, and safety assessments each relied on single expert evaluators.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 29 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our search of commercial marketplace identified a total of 310 unique apps.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The 53 manuscripts [9,14,15,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48, 49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65, 66,67,68,69,70,71] identified as relevant to the review made mention of a total of 48 unique apps that met our inclusion/exclusion criteria.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One hundred and four of these apps identified in the commercial marketplace meet our inclusion/exclusion criteria.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“10.26% (n = 12) of these apps identified through our search offer support that seems to be consistent with evidence-based principles of CBT or BA.”
- Also stated in: § App characteristics · plain
“Twelve of these 117 apps (10.26%) were classified by the reviewers as delivering CBT or BA; these CBT/BA apps were identified in the description by their developers as CBT or BA apps or they seemed to offer CBT or BA based on their general description (Table 3).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
- Also stated in: § App characteristics · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fifty-three out of 160 were relevant for our review because all them mention at least one native app addressed to people for depression.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One hundred and seventeen apps have been identified after searching both the scientific literature and the commercial market.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The usability of reviewed apps is highly variable”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Abstract
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The usability expert's ratings are valid.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“they rarely are accompanied by explicit privacy or safety policies.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No relationship was found between the level of adherence of the app to the theoretical CBT or BA model and the level of adherence with the heuristics usability (rs = -0.45, p = 0.13 and rs = 0.30, p = 0.33, respectively).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For instance, the Depression CBT Self-Help Guide app has the highest fidely to CBT models, but the low usability score could complicate its use.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The evaluation of CBT/BA content by one expert is a valid measure of the apps' fidelity to CBT/BA models.
- Probably not a substantial claim. 23
- It may state two separate claims as one. 15
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The literature search yielded 2,789 abstracts”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“160 full text manuscripts were reviewed at the full-text level.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > Search
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The 53 manuscripts included at this stage mentioned a total of 253 native apps for people with depression.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Search strategy
Strength:plain· not yet calibratedn = 253Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“All the apps identified through searching the scientific literature were simply cited in reviews [14]; they were not evaluated in primary research studies.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
What the sources say
- Not checked yetcites [14] N Shen, 2015, Finding a depression App: A review and content analysis of the depression app marketplace, J Med Internet Res
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The cost of these CBT/BA apps ranged from $0.00 to $8.99.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, this app was not the one that received the highest number of reviews.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The iPhone apps that received the highest number of reviews were the Anti-depression and MoodTools–Depression Aid apps, both of them also available for download in the Google Play store.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Its privacy policy indicates what information is collected and for what purpose, whether this information is shared with others but it does not address users control.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The few available apps that offer CBT or BA have either not been tested or the results derived from these tests have not been reported in the scientific literature.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most typical type of self-help support delivered through these 117 apps was education (n = 32, 27.35%) and diagnostic/screening support (n = 30, 25.64%), followed by state induction (n = 18, 15.38%).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > App characteristics
Strength:plain· not yet calibratedn = 18Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This policy is available on the developer’s homepage but is also available to users after they have downloaded the app.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Five of the 12 CBT/BA apps (41.67%) were available on iOS only and 5 (41.67%) on Android only.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Depression CBT Self-Help Guide and The Mood Tools–Depression Aid were those Android apps with the highest number of downloads (i.e., between 100,000 and 500,000 downloads, and between 50,000 and 100,000, respectively) and received high user satisfaction ratings (average satisfaction rates were 4.2 and 4.3, respectively).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The iPhone app that received the highest user satisfaction rating was The Depression Cure: The Free 12 Week Course app (average satisfaction rating = 4.5).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of the total 117 apps, 36 apps (30.77%) were available on iOS only, 74 (63.25%) were available on Android only, and 7 (5.98%) were available across both platforms.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > App characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The eCBTapp has a brief privacy policy that states that the information collected in the app is only accessed by the application on the device and they do not collect any information about the user or the use of the app.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Depression CBT Self-Help Guide app’s privacy policy applies to this app in particular, but also other products of its developer (other apps and its homepage).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Depression CBT Self-Help Guide and The Mood Tools–Depression Aid were those Android apps with the highest number of downloads (i.e., between 100,000 and 500,000 downloads, and between 50,000 and 100,000, respectively) and received high user satisfaction ratings (average satisfaction rates were 4.2 and 4.3, respectively).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Results > CBT/BA apps characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
In the paper
“Smartphones have been used to facilitate the delivery of healthcare interventions including treatment of mental health conditions [13].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Introduction
What the sources say
- Not checked yetcites [13] Michael S. Application of smartphone technology in the management and treatment of mental illnesses. MPH. Thesis, University of Pittsburgh. 2011. Available: http://d-scholarship.pitt.edu/6783/
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“The level of agreement between the two reviewers when categorizing the apps, using the Cohen’s kappa, was 0.92, indicating almost perfect agreement [17].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Data extraction
What the sources say
- Not checked yetcites [17] JR Landis, 1977, The measurement of observer agreement for categorical data, Biometrics source
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Both CBT and BA have meta-analytic level of evidence in the treatment of depression[6,7].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Introduction
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Taking into account the non existence of effectiveness/efficacy studies, and the low level of adherence to the core ingredients of the CBT/BA models, the utility of these CBT/BA apps are questionable.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Cross-referencing with apps identified in the scientific literature is sufficient to determine whether any efficacy or effectiveness study exists for the included CBT/BA apps.
In the paper
“If a privacy policy was available the evaluator assessesed the scope and the level of transparency of the policy as done by Sunyaev et al. [21].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Data extraction
What the sources say
- Not checked yetcites [21] A Sunyaev, 2015, Availability and quality of mobile mental health app privacy policies, J Am Med Inform Assoc source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“He evaluated the user interface of each app using a common list of usability heuristics proposed by Nielsen & Mack [20].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Data extraction
What the sources say
- Not checked yetcites [20] J Nielsen, 1994
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“With almost perfect agreement observed at this third level of screening (kappa = 0.92) [17], the remaining apps were reviewed by only one reviewer (SR).”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Search strategy
What the sources say
- Not checked yetcites [17] JR Landis, 1977, The measurement of observer agreement for categorical data, Biometrics source
Strength:plain· not yet calibratedn = 125Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The level of agreement between both independent reviewers using the Cohen’s Kappa was 0.89.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Methods > Search strategy
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Cognitive Behavioural Therapy (CBT) and Behavioural Activation (BA) are now an accepted evidence-based first-line treatment for depression [5].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Introduction
What the sources say
- Not checked yetcites [5] National Collaborating Centre for Mental Health. Depression: The treatment and management of depression in adults. 2010. Available: https://www.nice.org.uk/guidance/cg90/evidence/cg90-depression-in-adults-full-guidance2
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although expert opinion plays an important role when no research evidence exists, the use of an expert panel instead of only one expert could have increased the credibility of the conclusions.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“This finding is not surprising; previous reviews have found no relationship between the quality of the apps and consumers reviews or ratings [73,74].”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
What the sources say
- Not checked yetcites [73] NF BinDhim, 2015, A systematic review of quality assessment methods for smartphone health apps
- Not checked yetcites [74] Kuehnhausen M, Frost VS. Trusting smartphone apps? To install or not to install, that is the question. Cognitive Methods in Situation Awareness and Decision Support; IEEE International Multi-Disciplinary Conference; 2013 Feb 25–28; San Diego, CA, USA. IEEE; 2013. pp. 30–37. source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“First, this review was limited to English downloadable apps in Canada and only looked at the two most popular platforms when exploring the commercial market.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, the evaluation of the CBT and BA apps was based on the opinion of one expert.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, users should be careful when using the information available on the app download page to judge the app, since this information can be misleading.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
- Rests on an assumption: The number of downloads, user ratings, and reviews are valid indicators of an app's popularity.
In the paper
“Chan et al. [16] suggest evaluating apps on three broad dimensions: usefulness, usability, and integration/infrastructure.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
What the sources say
- Not checked yetcites [16] S Chan, 2015, Towards a framework for evaluating mobile mental health apps, Telemed J E Health source
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, although it was not the primary goal of this review, the lack of common constructs, outcome measures, definitions and/or standards for tracking, state induction, diagnostic/screening, and education apps make cross-case comparison of these different types of self-help apps impossible.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Chan et al. [16] have recently proposed a framework that can be used for patients and health care providers to evaluate existing mental health mobile apps and help them make informed choices about their use.”
§ A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression > Discussion
What the sources say
- Not checked yetcites [16] S Chan, 2015, Towards a framework for evaluating mobile mental health apps, Telemed J E Health source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
App store descriptions and manuscript descriptions accurately represent the type of support an app offers.
“The app description displayed in the stores and any available description provided in the manuscript was the only information used by the reviewers to base their decisions on which category each app fell into.”
The paper relies on this without support.
The development process, usability, feasibility, and efficacy of apps developed in the commercial marketplace are rarely assessed or reported.
“however the development process, usability, feasibility, and efficacy of these apps developed in the commercial marketplace are rarely assessed or reported.”
The paper relies on this without support.
The quality of available apps for depression had not been the subject of any systematic reviews before this review.
“The quality of the available apps has not been the subject of any systematic reviews, until now.”
The paper relies on this without support.
The search query 'depression' and the two app stores (Canadian Apple App Store and Android Market) capture the relevant available apps for depression.
“The search was restricted to apps available through the two most popular mobile phone platforms, The Canadian Apple App Store and Android Market (Google Play). The search was made in November 2015 using ‘depression’ as the search query.”
The paper relies on this without support.
Cross-referencing with apps identified in the scientific literature is sufficient to determine whether any efficacy or effectiveness study exists for the included CBT/BA apps.
“To evaluate the effectiveness of the apps, we cross-referenced with apps identified in the scientific literature to see whether there was any efficacy or effectiveness study on apps included in the review.”
The paper relies on this without support.
The expert's ratings of adherence to CBT/BA core ingredients are valid.
“an experienced academic CBT clinician (SR) evaluated the apps for their level of fidelity to theoretical CBT and BA principles by exploring what extent the apps included the core ingredients of these models.”
The paper relies on this without support.
The usability expert's ratings are valid.
“a user experience designer (MW), who regulary performs expert reviews on mobile apps and websites, where he applies heuristics and professional experience to evaluate user interfaces and suggest design improvements, evaluated the usability of the apps.”
The paper relies on this without support.
The number of downloads, user ratings, and reviews are valid indicators of an app's popularity.
“Also, no relationship was found between level of adherence of the app to the theoretical models and the indicators of popularity (range = rs = -0.02, p = 0.96 and rs = 0.57, p = 0.18), or between level of adherence of the app with the heuristic usability with the indicators of popularity (range = rs = 0.15, p = 0.68 and rs = 0.59, p = 0.07).”
The paper relies on this without support.
The core ingredients of CBT and BA used in the evaluation are the necessary components for a CBT or BA program to be effective.
“Of those apps which do use CBT or BA, some apps may provide benefits by partially applying CBT or BA principles, but the majority do not come close to including the core ingredients of a CBT or BA program.”
The paper relies on this without support.
The usability heuristics used are appropriate for evaluating the usability of CBT/BA apps.
“The usability heuristic evaluation found that the median level of adherence with the heuristics was 83% (range = 42–98%).”
The paper relies on this without support.
The evaluation of CBT/BA content by one expert is a valid measure of the apps' fidelity to CBT/BA models.
“Second, the evaluation of the CBT and BA apps was based on the opinion of one expert.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, a meta-analysis of 117 CBT-based applications revealed that only 12 of them provided support aligned with the evidence-based tenets of CBT.46”
From Mixed-methods feasibility outcomes for a novel ACT-based video game ‘ACTing Minds’ to support mental health (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Even among those purporting to be drawn from evidence-based therapies such as cognitive behavioural therapy, only a small percentage actually contain the core principles of those therapeutic traditions (19).”
From What Works and What Doesn’t Work? A Systematic Review of Digital Mental Health Interventions for Depression and Anxiety in Young People (2019) · cites this paper as [19]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This finding suggests that the observed effectiveness in earlier studies could potentially stem from participants’ interaction with a DHI (perhaps as a form of distraction) rather than their proficient implementation of CBT principles.”
From Mixed-methods feasibility outcomes for a novel ACT-based video game ‘ACTing Minds’ to support mental health (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredIn the citing paper
“For iCBT, very few of the products that claim to be based on cognitive-behavioral therapy (CBT) actually contain the CBT core elements (56).”
From Banbury forum consensus statement on the path forward for digital mental health treatment (2021) · cites this paper as [56]
In the citing paper
“In the past 5 years, a number of literature reviews have highlighted the increase in research and development activities for eMental healthcare technologies for children and adolescents [18-22].”
From eMental Healthcare Technologies for Anxiety and Depression in Childhood and Adolescence: Systematic Review of Studies Reporting Implementation Outcomes (2018) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Privacy-policy description conflicts with Table 7
MinorThe text says the Depression CBT Self-Help Guide policy does not address user control, while Table 7 marks its user-control category as addressed.
“it does not address users control.”
“| Depression CBT Self-Help Guide | ✓ | This app plus other apps created by the developer, and the homepage | ✓ | ✓ | ✓ | ✓ | ✗ | |”
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
Mood disorders in children and adolescents: an epidemiologic perspective
Kessler, R. C., Avenevoli, S., & Ries Merikangas, K. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(01)01129-5 · Cited by 1,181
Behavioral activation treatments of depression: a meta-analysis.
Cuijpers, P., van Straten, A., & Warmerdam, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.11.001 · Cited by 1,144
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 2×
“The lack of empirically tested apps identified during this review is consistent with observations in other health fields [36] and raises concerns about relying on these tools to support treatment for depression.”
BackgroundResultNational Collaborating Centre for Mental Health
Veale, D. M. (2006) · Research Portal (King's College London) · Cited by 941
Kessler, R. C. (2012) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2011.11.005 · Cited by 871
The National Collaborating Centre for Mental Health
Kendall, T., & Pilling, S. (2004) · UCL Discovery (University College London) · Cited by 840
The Current State of Cognitive Therapy: A 40-Year Retrospective
Beck, A. T. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.9.953 · Cited by 816
Flagged first, then by citations
2 of the 74 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- J.A. Callan, CBT mobilework: A technological solution to improve depression outcomes, Clinical and Translational Science, 4, 120
- M Murugan, Mobile phone based supportive patient care, Indian Journal of Psychiatry, 55, S72
- 2004, Depression: management of depression in primary and secondary care, Clinical Guideline, 23
Cited by
Sorted by citations
Items 101–200 of 328
Rohani, D. A., Tuxen, N., Lopategui, A. Q., Faurholt-Jepsen, M., Kessing, L. V., & Bardram, J. E. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329214 · Cited by 33
User Perspectives on a Resilience-Building App (JoyPop): Qualitative Study
Mushquash, A. R., Pearson, E. S., Waddington, K., MacIsaac, A., Mohammed, S., Grassia, E., Smith, S., & Wekerle, C. (2021) · JMIR mhealth and uhealth · doi:10.2196/28677 · Cited by 37
Price, G. D., Heinz, M. V., Collins, A. C., & Jacobson, N. C. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115693 · Cited by 37
Quality of Smartphone Apps Related to Alcohol Use Disorder
Penzenstadler, L. E., Chatton, A., Singer, M. V., & Khazaal, Y. (2016) · European Addiction Research · doi:10.1159/000449097 · Cited by 33
Ha, S. W., & Kim, J. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1750792 · Cited by 32
Caiani, E. G., Kemps, H., Hoogendoorn, P., Asteggiano, R., Böhm, A., Borregaard, B., Boriani, G., Rocca, H. B., Casado-Arroyo, R., Castelletti, S., et al. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae042 · Cited by 32
Bowie-DaBreo, D., Sas, C., Iles‐Smith, H., & Sünram‐Lea, S. I. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517498 · Cited by 36
Young, C., Trapani, K., Dawson, S. L., O'Neil, A. E., KAY‐LAMBKIN, F. J., Berk, M., & Jacka, F. N. (2018) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867418788659 · Cited by 32
Kulikov, V. N., Crosthwaite, P. C., Hall, S. A., Flannery, J., Strauss, G., Vierra, E., Koepsell, X., Lake, J. I., & Padmanabhan, A. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1062471 · Cited by 35
Hilty, D. M., Chan, S., Hwang, T., Wong, A., & Bauer, A. M. (2018) · Focus · doi:10.1176/appi.focus.16301 · Cited by 31
McCall, T., Ali, M. O., Yu, F., Fontelo, P. A., & Khairat, S. (2021) · JMIR Formative Research · doi:10.2196/24393 · Cited by 31
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. J. (2021) · JMIR mhealth and uhealth · doi:10.2196/26712 · Cited by 35
Dahne, J., Lejuez, C. W., Kustanowitz, J., Felton, J. W., Díaz, V. A., Player, M. S., & Carpenter, M. J. (2017) · The International Journal of Psychiatry in Medicine · doi:10.1177/0091217417720899 · Cited by 34
Buttazzoni, A. N., Brar, K., & Minaker, L. M. (2020) · Journal of Medical Internet Research · doi:10.2196/16490 · Cited by 34
Is the world ready for ChatGPT therapists?
Graber-Stiehl, I. (2023) · Nature · doi:10.1038/d41586-023-01473-4 · Cited by 32
Shen, Y., Hu, Y., Zhou, Y., & Fan, X. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1188327 · Cited by 29
Mobile Health Interventions for Psychiatric Conditions in Children
Archangeli, C., Marti, F., Pasiah, E., & Zima, B. T. (2016) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2016.07.009 · Cited by 30
Galvan-Tejada, C. E., Zanella-Calzada, L. A., Gamboa-Rosales, H., Galván-Tejada, J. I., Chávez-Lamas, N. M., Gracia-Cortés, M. D. C., Magallanes‐Quintanar, R., & Celaya-Padilla, J. M. (2019) · Mobile Information Systems · doi:10.1155/2019/8269695 · Cited by 28
Building Better Schools with Evidence-based Policy
Allen, K., Reupert, A., & Oades, L. G. (2021) · Routledge eBooks · doi:10.4324/9781003025955 · Cited by 35
Quantifying gender preferences in human social interactions using a large cellphone dataset
Ghosh, A., Monsivais, D., Bhattacharya, K., Dunbar, R., & Kaski, K. K. (2019) · EPJ Data Science · doi:10.1140/epjds/s13688-019-0185-9 · Cited by 29
An Introduction to Core Competencies for the Use of Mobile Apps in Cognitive and Behavioral Practice
Schueller, S. M., Armstrong, C. M., Neary, M., & Ciulla, R. (2020) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2020.11.002 · Cited by 29
HabitWorks: Development of a CBM-I Smartphone App to Augment and Extend Acute Treatment
Beard, C., Ramadurai, R., McHugh, R. K., Pollak, J. P., & Björgvinsson, T. (2021) · Behavior Therapy · doi:10.1016/j.beth.2020.04.013 · Cited by 29
Barnett, S., Huckvale, K., Christensen, H. M., Venkatesh, S., Mouzakis, K., & Vasa, R. (2019) · Journal of Medical Internet Research · doi:10.2196/16399 · Cited by 29
Experiences and implications of smartphone apps for depression and anxiety
Crosby, L., & Bonnington, O. (2020) · Sociology of Health & Illness · doi:10.1111/1467-9566.13076 · Cited by 27
Schroeder, J., Suh, J., Wilks, C. R., Czerwinski, M. P., Munson, S. A., Fogarty, J. A., & Althoff, T. (2020) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3421975 · Cited by 27
Mobile App Tools for Identifying and Managing Mental Health Disorders in Primary Care
Magee, J. C., Adut, S., Brazill, K., & Warnick, S. (2018) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-018-0154-0 · Cited by 25
Computer-Assisted CBT and Mobile Apps for Depression: Assessment and Integration Into Clinical Care
Wright, J. H., & Mishkind, M. C. (2020) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.20190044 · Cited by 27
Toh, S. H. Y., Tan, J. H. Y., Kosasih, F. R., & Sündermann, O. (2022) · JMIR Formative Research · doi:10.2196/40723 · Cited by 25
Fabian, K. E., Foster, K. T., Chwastiak, L., Turner, M., & Wagenaar, B. H. (2023) · Translational Behavioral Medicine · doi:10.1093/tbm/ibad041 · Cited by 26
Unguided Mental Health Self-help Apps: Reflections on Challenges through a Clinician's Lens
Mehrotra, S., Kumar, S., Sudhir, P. M., Rao, G. N., Thirthalli, J., & Gandotra, A. (2017) · Indian Journal of Psychological Medicine · doi:10.4103/ijpsym.ijpsym_151_17 · Cited by 26
Bowie-DaBreo, D., Sünram‐Lea, S. I., Sas, C., & Iles‐Smith, H. (2020) · JMIR Formative Research · doi:10.2196/14988 · Cited by 26
Free mobile apps on depression for Indian users: A brief overview and critique
Kumar, S., & Mehrotra, S. (2017) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2017.03.031 · Cited by 25
Suh, J., Howe, E. S., Lewis, R., Hernandez, J., Saha, K., Althoff, T., & Czerwinski, M. P. (2024) · JMIR Mental Health · doi:10.2196/48974 · Cited by 26
Mobile Health Interventions for Traumatic Brain Injuries
Juengst, S. B., Hart, T., Sander, A. M., Nalder, E. J., & Pappadis, M. R. (2019) · Current Physical Medicine and Rehabilitation Reports · doi:10.1007/s40141-019-00240-9 · Cited by 25
Glattacker, M., Boeker, M., Anger, R., Reichenbach, F., Tassoni, A., Bredenkamp, R., & Giesler, J. M. (2020) · JMIR mhealth and uhealth · doi:10.2196/15514 · Cited by 28
Role of mHealth in overcoming the occurrence of post-stroke depression
Miranda, J. J., Moscoso‐Porras, M., Toyama, M., Cavero, V., Diez‐Canseco, F., & Ovbiagele, B. (2017) · Acta Neurologica Scandinavica · doi:10.1111/ane.12832 · Cited by 25
Meyer, T. D., Casarez, R. L., Mohite, S., Rosa, N. L. L., & Iyengar, M. S. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.09.012 · Cited by 30
Preferences for Digital Smartphone Mental Health Apps Among Adolescents: Qualitative Interview Study
Ribanszki, R., Fonseca, J. A. S., Barnby, J. M., Jano, K., Osmani, F., Almasi, S., & Tsakanikos, E. (2021) · JMIR Formative Research · doi:10.2196/14004 · Cited by 25
Mccall, T., Threats, M., Pillai, M., Lakdawala, A., & Bolton, C. S. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1028408 · Cited by 20
Lin, X., Martinengo, L., Jabir, A. I., Ho, A. H. Y., Car, J., Atun, R. A., & Car, L. T. (2023) · Journal of Medical Internet Research · doi:10.2196/45984 · Cited by 24
Abouzari, M., Goshtasbi, K., Sarna, B., Ghavami, Y., Parker, E. M., Khosravi, P., Mostaghni, N., Jamshidi, S., Saber, T., & Djalilian, H. R. (2021) · Annals of Otology, Rhinology & Laryngology · doi:10.1177/0003489420962818 · Cited by 22
Characteristics and quality of genetics and genomics mobile apps: a systematic review
Talwar, D., Yeh, Y.-L., Chen, W., & Chen, L. (2019) · European Journal of Human Genetics · doi:10.1038/s41431-019-0360-2 · Cited by 22
Scherr, S., & Goering, M. (2019) · Health Communication · doi:10.1080/10410236.2019.1606135 · Cited by 23
Efficacy, Safety, and Evaluation Criteria of mHealth Interventions for Depression: Systematic Review
Duarte‐Díaz, A., Perestelo‐Pérez, L., Gelabert, E., Robles, N., Pérez-Navarro, A., Vidal‐Alaball, J., Solà-Morales, O., Sales-Masnou, A., & Carrión, C. (2023) · JMIR Mental Health · doi:10.2196/46877 · Cited by 27
Pozuelo, J. R., Moffett, B., Davis, M., Stein, A. L., Cohen, H., Craske, M. G., Maritze, M., Makhubela, P., Nabulumba, C., Sikoti, D., et al. (2023) · JMIR Formative Research · doi:10.2196/51423 · Cited by 22
Briffault, X., Morgiève, M., & Courtet, P. (2018) · Brain Sciences · doi:10.3390/brainsci8060098 · Cited by 21
The Guardians: Designing a Game for Long-term Engagement with Mental Health Therapy
Ferguson, C., Lewis, R., Wilks, C. R., & Picard, R. W. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619026 · Cited by 23
Depressive symptoms and web user experience
Thielsch, M. T., & Thielsch, C. (2018) · PeerJ · doi:10.7717/peerj.4439 · Cited by 21
The Interactive Mobile App Review Toolkit (IMART): a Clinical Practice-Oriented System
Maheu, M. M., Nicolucci, V., Pulier, M. L., Wall, K. M., Frye, T. J., & Hudlická, E. (2016) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-016-0005-z · Cited by 21
Wytykowska, A., Fajkowska, M., Domaradzka, E., & Jankowski, K. S. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2016.12.054 · Cited by 24
Zuccolo, P. F., Xavier, M. O., Matijasevich, A., Polanczyk, G. V., & Fatori, D. (2021) · Trials · doi:10.1186/s13063-021-05179-8 · Cited by 21
Miller, I., Peake, E., Strauss, G., Vierra, E., Koepsell, X., Shalchi, B., Padmanabhan, A., & Lake, J. (2023) · JMIR Formative Research · doi:10.2196/43260 · Cited by 19
Ollier, J., Suryapalli, P., Fleisch, E., von Wangenheim, F., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1185702 · Cited by 20
Stalujanis, E., Neufeld, J., Stalder, M. G., Belardi, A., Tegethoff, M., & Meinlschmidt, G. (2020) · JMIR mhealth and uhealth · doi:10.2196/20329 · Cited by 19
Multiple sclerosis and anxiety: Is there an untapped opportunity for exercise?
Šilić, P., Motl, R. W., & Duffecy, J. L. (2023) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2023.104698 · Cited by 18
Lukka, L., Karhulahti, V., & Palva, J. M. (2023) · JMIR Human Factors · doi:10.2196/44681 · Cited by 20
Bubolz, S., Mayer, G., Gronewold, N., Hilbel, T., & Schultz, J. (2020) · Journal of Medical Internet Research · doi:10.2196/16136 · Cited by 18
Promises and risks of web-based interventions in the treatment of depression
Hegerl, U., & Oehler, C. (2020) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2020.22.2/uhegerl · Cited by 17
Planas, R., & Yuguero, O. (2021) · Informatics for Health and Social Care · doi:10.1080/17538157.2021.1887196 · Cited by 17
Digital Mental Health Services: Moving From Promise to Results
Teachman, B. A., Silverman, A. L., & Werntz, A. J. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2021.06.014 · Cited by 19
Martín‐Martín, J., Muro-Culebras, A., Roldán‐Jiménez, C., Escriche-Escuder, A., De-Torres, I., González‐Sánchez, M., Ruiz‐Muñoz, M., Mayoral, F., Biró, A., Tang, W. J., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312505 · Cited by 15
Facets of adaptability in career decision-making
Levin, N., & Lipshits‐Braziler, Y. (2021) · International Journal for Educational and Vocational Guidance · doi:10.1007/s10775-021-09489-w · Cited by 19
Jenness, J. L., Bhattacharya, A., Kientz, J. A., Munson, S. A., & Nagar, R. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104065 · Cited by 14
Eagle, T., Mehrotra, A., Sharma, A., Zuniga, A., & Whittaker, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555155 · Cited by 16
Weiner, L. S., Crowley, R. N., Sheeber, L., Koegler, F. H., Davis, J. F., Wells, M., Funkhouser, C. J., Auerbach, R. P., & Allen, N. B. (2024) · JMIR Mental Health · doi:10.2196/51366 · Cited by 20
Evaluating Commercially Available Mobile Apps for Depression Self-Management.
Myers, A., Chesebrough, L., Hu, R., Turchioe, M. R., Pathak, J., & Creber, R. M. (2020) · PubMed Central · Cited by 14
Borrione, L., Suen, P. J. C., Razza, L. B., dos Santos, L. A., Sudbrack-Oliveira, P., & Brunoni, A. R. (2020) · Expert Review of Medical Devices · doi:10.1080/17434440.2020.1813565 · Cited by 14
Preliminary effects of a digital mental health intervention for depression and anxiety
van Orden, M. L., Kraaijeveld, J. C., Spijker, A. T., Silven, A. V., Bonten, T. N., Chavannes, N. H., & van Dijke, A. (2022) · Clinical eHealth · doi:10.1016/j.ceh.2022.06.002 · Cited by 13
Mobile health applications for health-care delivery: trends, opportunities, and challenges
Goel, A., & Taneja, U. (2023) · Journal of Public Health · doi:10.1007/s10389-023-02165-z · Cited by 16
The evolution of psychotherapy: from Freud to prescription digital therapeutics
Docherty, J. P., & Colbert, B. M. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1477543 · Cited by 14
Häfner, J., Schönfeld, S., Tokgöz, P., Choroschun, K., Schlubach, A., & Dockweiler, C. (2022) · Healthcare · doi:10.3390/healthcare10102019 · Cited by 13
Wells, K. B., Thames, A. D., Young, A. S., Zhang, L., Heilemann, M. V., Romero, D. F., Oliva, A., Jones, F., Tang, L., Brymer, M. J., et al. (2022) · JMIR Formative Research · doi:10.2196/42031 · Cited by 13
Supporting smartphone-based behavioral activation
Bardram, J. E., Rohani, D. A., Tuxen, N., Faurholt‐Jepsen, M., & Kessing, L. V. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3125617 · Cited by 13
mHealth for Mental Health in the COVID-19 Era
Lee, S., Shin, H., & Hur, J. (2020) · The Korean Journal of Clinical Psychology · doi:10.15842/kjcp.2020.39.4.007 · Cited by 12
Cobb, C. L. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13703 · Cited by 13
Fernandes, C.-S. F., Deng, Y., Tran, A. H., Hieftje, K. D., Pendergrass, T. M., Taylor, C. K., & Fiellin, L. E. (2022) · Games for Health Journal · doi:10.1089/g4h.2021.0118 · Cited by 13
Effectiveness of Gamification in mHealth Apps Designed for Mental Illness
Santoso, I. S., Ferdinansyah, A., Sensuse, D. I., Suryono, R. R., Kautsarina, K., & Hidayanto, A. N. (2021) · International Conference on ICT for Rural Development (IC-ICTRuDev) · doi:10.1109/ic-ictrudev50538.2021.9655706 · Cited by 12
Patterson, V. C., Rossi, M. A., Pencer, A., & Wozney, L. (2022) · JMIR Formative Research · doi:10.2196/33374 · Cited by 11
Self-citationPotential treatments of technology addiction: insights for information systems scholars
Ning, W., Turel, O., & Davis, F. D. (2024) · Internet Research · doi:10.1108/intr-12-2023-1122 · Cited by 16
Rajeshkumar, L., Mishkind, M. C., Coleman, J. J., Pahwa, M., LaPreze, D., Solenske, S., & Wright, J. H. (2024) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000815 · Cited by 12
Nagar, R., Quirk, H. D., & Anderson, P. L. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100676 · Cited by 12
Hollier, J. M., Vaughan, A. O., Liu, Y., van Tilburg, M. A. L., Shulman, R. J., & Thompson, D. I. (2018) · JMIR Pediatrics and Parenting · doi:10.2196/pediatrics.8535 · Cited by 11
Yan, G., Zhang, M., Liu, Y., & Yin, M. (2019) · Psychogeriatrics · doi:10.1111/psyg.12426 · Cited by 11
Retracteddo Prado, L. S., Carpentier, C., Préau, M., Schott, A., & Dima, A. L. (2019) · JMIR mhealth and uhealth · doi:10.2196/13494 · Cited by 15
Is there an app for that? A review of popular mental health and wellness appsPreprint
Wasil, A. R., Palermo, E. H., Lorenzo‐Luaces, L., & DeRubeis, R. J. (2021) · doi:10.31234/osf.io/su4ar · Cited by 11
Ooi, P. B., & Wilkinson, G. G. (2024) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2024.2373180 · Cited by 13
Designing Chatbots to Treat Depression in Youth: Qualitative Study
Kuhlmeier, F. O., Bauch, L., Gnewuch, U., & Lüttke, S. (2025) · JMIR Human Factors · doi:10.2196/66632 · Cited by 11
Bao, T., Deng, G. E., DeMarzo, L. A., Zhi, W. I., DeRito, J. L., Blinder, V. S., Chen, C., Li, Q. S., Green, J. A., Pendleton, E., et al. (2019) · JMIR Cancer · doi:10.2196/13217 · Cited by 12
Managing depression in India: Opportunities for a targeted smartphone app
Ramnath, S., & Suri, G. (2021) · International Journal of Social Psychiatry · doi:10.1177/00207640211032253 · Cited by 10
Guided Internet-Delivered Treatment for Depression: Scoping Review
Børtveit, L., Dechsling, A., Sütterlin, S., Nordgreen, T., & Nordahl‐Hansen, A. (2022) · JMIR Mental Health · doi:10.2196/37342 · Cited by 11
Moffett, B., Pozuelo, J. R., van Heerden, A. C., O’Mahen, H., Craske, M. G., Sodi, T., Lund, C., Orkin, K., Kilford, E. J., Blakemore, S., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-065977 · Cited by 11
Goodsmith, N., Moore, E. M., Siddiq, H., Barceló, N. E., Ulloa-Flores, E., Loera, G., Jones, F., Aguilar‐Gaxiola, S., Wells, K. B., & Arevian, A. C. (2022) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2022.0039 · Cited by 10
Digitized thought records: a practitioner-focused review of cognitive restructuring apps
Erhardt, D., Bunyi, J., Dodge-Rice, Z., Neary, M., & Schueller, S. M. (2022) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x22000320 · Cited by 13
Rookes, T., Nimmons, D., Frost, R., Armstrong, M., Davies, L., Ross, J., Hopkins, J., Mistry, M., Taylor, S. J., & Walters, K. R. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-081104 · Cited by 9
Pozuelo, J. R., Nabulumba, C., Sikoti, D., Davis, M., Gumikiriza‐Onoria, J. L., Kinyanda, E., Moffett, B., van Heerden, A. C., O’Mahen, H., Craske, M. G., et al. (2024) · JMIR Serious Games · doi:10.2196/59381 · Cited by 10
Li, K., Magnuson, K. I., Beuley, G., Davis, L., & Ryan-Pettes, S. R. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/43626 · Cited by 8
Alwuqaysi, B., Abdul‐Rahman, A., & Borgo, R. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100513 · Cited by 9
Benjet, C. L., Kessler, R. C., Kazdin, A. E., Cuijpers, P. J., Albor, Y., Tapias, N. E. C., Contreras‐Ibáñez, C. C., González, M. S. D., Gildea, S. M., González, N., et al. (2022) · Trials · doi:10.1186/s13063-022-06255-3 · Cited by 10
Mobile Health Technologies to Deliver and Support Cognitive-Behavioral Therapy
Schueller, S. M., & Adkins, E. C. (2019) · Psychiatric Annals · doi:10.3928/00485713-20190717-02 · Cited by 9
Fatmawati, F., Stang, Palutturi, S., Amiruddin, R., & Syafar, M. (2020) · Enfermería Clínica · doi:10.1016/j.enfcli.2019.11.017 · Cited by 8
Metadata
- Authors
- Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S.
- Affiliations
- Dalhousie University (CA)
- Izaak Walton Killam Health Centre (CA)
- Corresponding author
- Huguet, Anna
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-05-02
- Volume
- 11
- Issue
- 5
- Pages
- e0154248
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4852920
- OpenAlex
- W2346033637
- Semantic Scholar
- d6006c7856b940bd31d69ba83edf42f73f09d783
- Cited by
- 328
- References
- 74
- Citations by year
- 2026: 10 · 2025: 16 · 2024: 26 · 2023: 31 · 2022: 38 · 2021: 44 · 2020: 53 · 2019: 40 · 2018: 34 · 2017: 30 · 2016: 6
- FWCI
- 5.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- depression, cognitive behavioral therapy, behavioral activation, mobile health apps, self-help apps, digital mental health, app usability
- MeSH terms
- Depression, Humans, Cognitive Behavioral Therapy, Cell Phone, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
