Smartphone-Supported versus Full Behavioural Activation for Depression: A Randomised Controlled Trial
Open accessThe DOI matches its Crossref record; 51 of the 53 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is need for more cost and time effective treatments for depression. This is the first randomised controlled trial in which a blended treatment--including four face-to-face sessions and a smartphone application--was compared against a full behavioural treatment. Hence, the aim of the current paper was to examine whether a blended smartphone treatment was non-inferior to a full behavioural activation treatment for depression. METHODS: This was a randomised controlled non-inferiority trial (NCT01819025) comparing a blended treatment (n=46) against a full ten-session treatment (n=47) for people suffering from major depression. Primary outcome measure was the BDI-II, that was administered at pre- and post-treatment, as well as six months after the treatment. RESULTS: Results showed significant improvements in both groups across time on the primary outcome measure (within-group Cohen's d=1.35; CI [-0.82, 3.52] to d=1.47; CI [-0.41, 3.35]; between group d=-0.13 CI [-2.37, 2.09] and d=-0.10 CI [-2.53, 2.33]). At the same time, the blended treatment reduced the therapist time with an average of 47%. CONCLUSIONS: We could not establish whether the blended treatment was non-inferior to a full BA treatment. Nevertheless, this study points to that the blended treatment approach could possibly treat nearly twice as many patients suffering from depression by using a smartphone application as add-on. More studies are needed before we can suggest that the blended treatment method is a promising cost-effective alternative to regular face-to-face treatment for depression. TRIAL REGISTRATION: Cognitive Behavioral Therapy Treatment of Depression With Smartphone Support NCT01819025.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research has shown that bCBT achieves similar outcomes to traditional CBT, despite reduced face-to-face time with therapists [27,33-35].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [33]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
An overview of randomization techniques: An unbiased assessment of outcome in clinical research
Suresh, K. (2011) · Journal of Human Reproductive Sciences · doi:10.4103/0974-1208.82352 · Cited by 1,070 · cited 1×
“Participants were allocated to the blended treatment or to the full BA treatment by using simple randomisation, which in larger samples can be trusted to generate similar numbers of subjects among groups [26].”
MethodRetractedDiagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · cited 5×
“When analysing the interventions separately with regards to changes in the outcomes, there were significant correlations on all measurements except from the BAI for the blended treatment group from pre- to post-measurement (r = −.56 to .31, p = 0.00 to 0.05), but no significant correlations for the full BA group (r =…”
MethodInfluentialBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597
(1998) · PubMed · Cited by 10,216
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Diagnostic and Statistical Manual of Mental Disorders
Siegel, L. J., & Fletcher‐Janzem, E. (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced0655 · Cited by 8,477
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · cited 4×
“%) of the participants of the blended treatment group were classified as responders according to the Jacobson and Truax criterions [31] compared to 24 participants (51.1”
MethodInfluentialBeck, A. T., Steer, R. A., & Brown, G. (2011) · PsycTESTS Dataset · doi:10.1037/t00742-000 · Cited by 7,535
The mini international neuropsychiatric interview
Lecrubier, Y., Sheehan, D., Hergueta, T., & Weiller, E. (1998) · European Psychiatry · doi:10.1016/s0924-9338(99)80239-9 · Cited by 5,872
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576 · cited 1×
“Maximum likelihood estimation provides unbiased estimates in the presence of missing observations under the less restrictive assumption that data are missing for ignorable non-random reasons [30].”
BackgroundPiaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428 · cited 1×
“Non-inferiority trials usually require large samples to detect small and clinically meaningful differences between two active treatments [43].”
BackgroundCredibility of analogue therapy rationales
Borkovec, T. D., & Nau, S. D. (1972) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(72)90045-6 · Cited by 1,553 · cited 1×
“To measure participants’ perceived treatment credibility, Borkovec and Nau’s Credibility/expectancy scale (C-Scale) [24] was distributed after the first week of treatment.”
MethodGueorguieva, R., & Krystal, J. H. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.3.310 · Cited by 1,529 · cited 1×
“using mixed effects models given their ability to handle missing data [29].”
MethodA psychometric evaluation of the Beck Depression Inventory–II.
Dozois, D. J. A., Dobson, K. S., & Ahnberg, J. L. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.2.83 · Cited by 1,517 · cited 1×
“[32] for the non-clinical means and standard deviations.”
BackgroundFactor structure of the working alliance inventory
Tracey, T. J., & Kokotovic, A. M. (1989) · Psychological Assessment: A Journal of Consulting and Clinical Psychology · doi:10.1037/1040-3590.1.3.207 · Cited by 1,501
Advantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 3×
“, combining an internet treatment program with live group sessions for social phobia) [10].”
BackgroundMethodInfluentialSelf-citationReporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · cited 1×
“Non-inferiority trials usually require large samples to detect small and clinically meaningful differences between two active treatments [43].”
BackgroundBehavioral activation treatments of depression: a meta-analysis.
Cuijpers, P., van Straten, A., & Warmerdam, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.11.001 · Cited by 1,144
Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.92 · Cited by 1,075 · cited 4×
“Thus, there were three measurements on the BAI, the QOLI and the AAQ-II, and a total of 13 measurements on the PHQ-9.”
MethodInfluentialBerman, A. H., Bergman, H., Palmstierna, T., & Schlyter, F. (2005) · European Addiction Research · doi:10.1159/000081413 · Cited by 977 · cited 1×
“In the first stage of the recruitment process, potential participants were instructed to complete an online screening survey comprised of the Beck Depression Inventory-II (BDI-II) [17], the PHQ-9 [18], the Beck Anxiety Inventory (BAI) [19], the Quality of Life Inventory (QOLI) [20] the Acceptance and Action Questionna…”
MethodA Practical Guide to Acceptance and Commitment Therapy
(2004) · doi:10.1007/978-0-387-23369-7 · Cited by 875
Cuijpers, P., Karyotaki, E., Weitz, E., Andersson, G., Hollon, S. D., & van Straten, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.02.026 · Cited by 586 · cited 4×
“Additionally, Cuijpers and co-workers [37] found that the BDI-II scores dropped on average 12.”
BackgroundMethodResultInfluentialSelf-citationAndrews, G., Issakidis, C., Sanderson, K., Corry, J., & Lapsley, H. (2004) · British Journal of Psychiatry · doi:10.1192/bjp.184.6.526 · Cited by 560 · cited 1×
“There is need for more cost and time effective treatments for major depression [1,2].”
BackgroundWhat is behavioral activation?
Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.04.001 · Cited by 515 · cited 3×
“Since it is known that BA works for major depression [9], the study was designed as a non-inferiority trial.”
BackgroundMethodNewman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 1×
“There is need for more cost and time effective treatments for major depression [1,2].”
BackgroundBehavioral activation treatments for depression in adults: A meta-analysis and review.
Mazzucchelli, T., Kane, R., & Rees, C. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01178.x · Cited by 438 · cited 1×
“BA has been found to be effective in a series of meta-analyses in the treatment of depression [6,7], and can be delivered by non-specialists [8].”
BackgroundMeyer, B., Berger, T., Caspar, F., Beevers, C. G., Andersson, G., & Weiss, M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1151 · Cited by 363 · cited 1×
“We hypothesised that the new treatment would be non-inferior to the standard treatment and consequently, overcome the drawbacks that previous studies have suggested, namely that adding digital components also increases costs and workload among professionals [11,12,13].”
BackgroundSelf-citationTitov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.550059 · Cited by 342 · cited 6×
“The PHQ-9 was also administered on a weekly basis during the entire treatment period.”
MethodInfluentialBehavioral Activation for Depression: A Clinician's Guide
Dahl, J. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.514119 · Cited by 334
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329
What Is Acceptance and Commitment Therapy?
Hayes, S. C., Strosahl, K. D., Bunting, K., Twohig, M., & Wilson, K. G. (2004) · A Practical Guide to Acceptance and Commitment Therapy · doi:10.1007/978-0-387-23369-7_1 · Cited by 301
Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials.
Weersing, V. R., & Weisz, J. R. (2002) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.70.2.299 · Cited by 301 · cited 1×
“This should be seen in the light of the findings of dose—response effects, showing that lower doses of psychotherapy have been associated with poorer outcomes [38,39,40].”
van der Vaart, R., Witting, M., Riper, H., Kooistra, L., Bohlmeijer, E. T., & van Gemert-Pijnen, L. J. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0355-z · Cited by 273 · cited 2×
“It has recently been suggested that this kind of blended approach should be further investigated in randomised controlled trials, since initial evaluation show that both patients and therapists expect more benefits than drawbacks from this format [11].”
BackgroundLy, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269 · cited 3×
“In light of the research support for BA [9] as well as of the initial promising findings of smartphone-delivered psychological treatment for depression [3,5], we assumed that a combination of these two aspects might be useful to explore in such a way that the number of treatment sessions would be reduced by means of t…”
BackgroundResultSelf-citationHopko, D. R., Lejuez, C. W., Lepage, J. P., Hopko, S. D., & McNeil, D. W. (2003) · Behavior Modification · doi:10.1177/0145445503255489 · Cited by 238 · cited 1×
“This limits the generalizability of the results, even if previous findings indicate that BA for depression is effective in regular clinical settings with similar outcomes as in studies involving public recruitments [42].”
ResultSzegedi, A., Kohnen, R., Dienel, A., & Kieser, M. (2005) · BMJ · doi:10.1136/bmj.38356.655266.82 · Cited by 220 · cited 1×
“measures and have been suggested in earlier non-inferiority trials [33,34].”
Behavioural activation delivered by the non-specialist: phase II randomised controlled trial
Ekers, D., Richards, D., McMillan, D., Bland, J. M., & Gilbody, S. (2011) · British Journal of Psychiatry · doi:10.1192/bjp.bp.110.079111 · Cited by 217 · cited 1×
“BA has been found to be effective in a series of meta-analyses in the treatment of depression [6,7], and can be delivered by non-specialists [8].”
BackgroundKadera, S. W., Lambert, M. J., & Andrews, A. A. (1996) · PubMed Central · Cited by 195
The use of mobile telephones as adjuncts to cognitive behavioral psychotherapy.
Boschen, M. J., & Casey, L. M. (2008) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.39.5.546 · Cited by 125
Kennard, B. D., Clarke, G. N., Weersing, V. R., Asarnow, J. R., Shamseddeen, W., Porta, G., Berk, M., Hughes, J. L., Spirito, A., Emslie, G. J., et al. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0017411 · Cited by 121 · cited 1×
“5 times more likely to have adequate treatment response than those who had 9 or fewer sessions [41].”
BackgroundFeasibility of an eHealth Service to Support Collaborative Depression Care: Results of a Pilot Study
Meglic, M., Furlan, M., Kuzmanic, M., Kozel, D., Baraga, D., Kuhar, I., Kosir, B., Iljaz, R., Novak Sarotar, B., Dernovsek, M. Z., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1510 · Cited by 71 · cited 1×
“We hypothesised that the new treatment would be non-inferior to the standard treatment and consequently, overcome the drawbacks that previous studies have suggested, namely that adding digital components also increases costs and workload among professionals [11,12,13].”
BackgroundClinically relevant effect sizes in depression
Montgomery, S. (1994) · European Neuropsychopharmacology · doi:10.1016/0924-977x(94)90093-0 · Cited by 68 · cited 1×
“measures and have been suggested in earlier non-inferiority trials [33,34].”
The dose response relationship in psychotherapy: Implications for social policy
Harnett, P., O'Donovan, A., & Lambert, M. J. (2010) · Clinical Psychologist · doi:10.1080/13284207.2010.500309 · Cited by 66 · cited 1×
“This should be seen in the light of the findings of dose—response effects, showing that lower doses of psychotherapy have been associated with poorer outcomes [38,39,40].”
Whose IQ is it?—Assessor bias variance in high-stakes psychological assessment.
McDermott, P. A., Watkins, M. W., & Rhoad, A. M. (2014) · Psychological Assessment · doi:10.1037/a0034832 · Cited by 53
Impact of missing data on type 1 error rates in non-inferiority trials
Yoo, B. (2010) · Pharmaceutical Statistics · doi:10.1002/pst.378 · Cited by 12 · cited 1×
“5% significance test on the null hypothesis, which states that the treatment is inferior by the non-inferiority margin or more as compared to the condition [35].”
BackgroundPower, M. (2013) · doi:10.1002/9781118316153.ch7 · Cited by 5
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
“Mobile app–administered therapy either stand-alone or in blended mode has been found to show positive effects on patients with depression across severity levels in randomized controlled trial (RCT) studies [23-28].”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675
Internet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595
“while still maintaining effects; for example, in one trial, a smartphone app was used as a way to reduce the number of face-to-face sessions in the treatment of depression (Ly et al. 2015).”
MethodSelf-citation
Metadata
- Authors
- Ly, K. H., Topooco, N., Cederlund, H., Wallin, A., Bergström, J., Molander, O., Carlbring, P., & Andersson, G.
- Affiliations
- Linköping University (SE)
- Stockholm University (SE)
- WeMind (SE)
- Corresponding author
- Ly, Kien Hoa
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-05-26
- Volume
- 10
- Issue
- 5
- Pages
- e0126559
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4444307
- OpenAlex
- W1661634967
- Semantic Scholar
- 8b82631f383453f4316519b4827fca9e8283fe4b
- Cited by
- 171
- References
- 53
- Citations by year
- 2026: 4 · 2025: 16 · 2024: 15 · 2023: 15 · 2022: 16 · 2021: 8 · 2020: 28 · 2019: 19 · 2018: 18 · 2017: 17 · 2016: 10 · 2015: 5
- FWCI
- 26.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DiVA (Linkoping University) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- European Commission (603098)
- Vetenskapsrådet (2011-02476)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- depression, behavioral activation, mobile application, blended treatment, non-inferiority, major depressive disorder, cost-effective treatment, cognitive behavioral therapy
- MeSH terms
- Smartphone, Adolescent, Adult, Aged, Anxiety, Demography, Depression, Female, Humans, Male, Middle Aged, Patient Compliance, Patient Dropouts, Psychiatric Status Rating Scales, Time Factors, Cognitive Behavioral Therapy, Treatment Outcome, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.