Cited by 33Digital Mental Health InterventionsTelemedicine and Telehealth ImplementationMental Health Treatment and Access

Feasibility of a UK community-based, eTherapy mental health service in Greater Manchester: repeated-measures and between-groups study of ‘Living Life to the Full Interactive’, ‘Sleepio’ and ‘Breaking Free Online’ at ‘Self Help Services’

Open access
Elison, Sarah, Ward, Jonathan, Williams, Chris, Espie, Colin, Davies, Glyn, Dugdale, Stephanie, Ragan, Kathryn, Chisnall, Leanne +2 more·2017·BMJ Open

Abstract

Objectives: There is increasing evidence to support the effectiveness of eTherapies for mental health, although limited data have been reported from community-based services. Therefore, this service evaluation reports on feasibility and outcomes from an eTherapy mental health service. Setting: ‘Self Help Services’, an Increasing Access to Psychological Therapies (IAPT) eTherapy service in Greater Manchester. Participants: 1068 service users referred to the service for secondary care for their mental health difficulties. Interventions: Participants were triaged into one of three eTherapy programmes: ‘Living Life to the Full Interactive’ for low mood, stress and anxiety; ‘Sleepio’ for insomnia; and ‘Breaking Free Online’ for substance misuse, depending on clinical need. Primary outcomes measures: Standardised psychometric assessments of depression, anxiety and social functioning, collected as part of the IAPT Minimum Data Set, were conducted at baseline and post-treatment. Results: Data indicated baseline differences, with the Breaking Free Online group having higher scores for depression and anxiety than the Living Life to the Full Interactive (depression CI 1.27 to 3.21, p<0.0001; anxiety CI 077 to 1.72, p<0.0001) and Sleepio (depression CI 1.19 to 4.52, p<0.0001; anxiety CI 2.16 to 5.23, p<0.0001) groups. Promising improvements in mental health scores were found within all three groups (all p<0.0001), as were significant reductions in numbers of service users reaching clinical threshold scores for mental health difficulties (p<0.0001). Number of days of engagement was not related to change from baseline for the Living Life to the Full or Sleepio programmes but was associated with degree of change for Breaking Free Online. Conclusion: Data presented provide evidence for feasibility of this eTherapy delivery model in supporting service users with a range of mental health difficulties and suggest that eTherapies may be a useful addition to treatment offering in community-based services.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2017-016392

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Sleepio has been well verified for its effectiveness in relieving insomnia and improving quality of life and depression related to insomnia based on numerous clinical studies.

    “For example, ‘Sleepio,’ which is a cognitive-behavioral therapy (CBT)-based therapy for insomnia by Big Health, has been well verified for its effectiveness in relieving insomnia and improving quality of life and depression related to insomnia based on numerous clinical studies over the past few years [8,9].”

    From A Review of Current Digital Mental Health Care Applications for Anxiety Symptoms and Future Prospects (2024) · cites this paper as [8]

    The Introduction (page unavailable) describes Sleepio as a CBT-informed programme demonstrated effective for insomnia and cites several prior studies. The Results (page unavailable) report reduced depression thresholds among Sleepio users. However, this paper does not establish an improvement in quality of life; its Limitations section says insomnia severity data were unavailable for its own Sleepio group. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • A large-scale (n=1,711) randomized trial of Sleepio conducted in 2015 confirmed that it improved both daytime and nighttime aspects of insomnia.

    “Its large-scale (n=1,711) randomized trial conducted in 2015 confirmed that it improved both daytime and nighttime aspects of insomnia.”

    From A Review of Current Digital Mental Health Care Applications for Anxiety Symptoms and Future Prospects (2024) · cites this paper as [8]

    The Introduction (page unavailable) describes Sleepio as effective for insomnia, which supports the general improvement claim. But this paper reports a community-service study of 1,068 users, not a 2015 randomized trial of 1,711 people. Its Limitations section says insomnia severity was not measured for the Sleepio group, so it cannot substantiate the claimed daytime and nighttime outcomes. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 45

  1. [2]Docherty M, Thornicroft G Specialist mental health services in England in 2014: overview of funding, access and levels of care. Int J Ment Health Syst 2015; 9: 34 10.1186/s13033-015-0023-9 26322123 PMC4553216 · DOI
  2. [10]Williams C, Whitfield G Written and computer-based self-help treatments for depression. Br Med Bull 2001; 57: 133– 44. 10.1093/bmb/57.1.133 11719913 · DOI
  3. [11]Richards D, Richards A, Barkham M, et al PHASE: a 'health technology' approach to psychological treatment in primary mental health care. Primary Health Care Research and Development 2002; 3: 159– 68. 10.1191/1463423602pc103oa · DOI
  4. [12]Bostock S, Luik AI, Espie CA Sleep and productivity benefits of digital cognitive behavioral therapy for insomnia: a randomized controlled trial conducted in the workplace environment. J Occup Environ Med 2016; 58: 683-9 10.1097/JOM.0000000000000778 27257747 · DOI
  5. [13]Espie CA, Hames P, McKinstry B Use of the internet and mobile media for delivery of cognitive behavioral insomnia therapy. Sleep Med Clin 2013; 8: 407– 19. 10.1016/j.jsmc.2013.06.001 · DOI
  6. [14]Espie CA, Kyle SD, Miller CB, et al Attribution, cognition and psychopathology in persistent insomnia disorder: outcome and mediation analysis from a randomized placebo-controlled trial of online cognitive behavioural therapy. Sleep Med 2014; 15: 913– 7. 10.1016/j.sleep.2014.03.001 24791643 · DOI
  7. [15]Coulson NS, Smedley R, Bostock S, et al The pros and cons of getting engaged in an online social community embedded within digital cognitive behavioral therapy for insomnia: survey among users. J Med Internet Res 2016; 18: e88 10.2196/jmir.5654 27113540 PMC4861843 · DOI
  8. [16]Elison S, Ward J, Davies G, et al An outcomes study of eTherapy for dual diagnosis using Breaking Free Online. Adv Dual Diagn 2014; 7: 52– 62. 10.1108/ADD-11-2013-0025 · DOI
  9. [17]Elison S, Davies G, Ward J, et al Sub-group analyses of a heterogeneous sample of service users accessing computer-assisted therapy (CAT) for substance dependence using Breaking Free Online. Journal of Medical Internet Research 2015; 2: e13. PMC4607383 26543918
  10. [18]Elison S, Davies G, Ward J et al An outcomes evaluation of computerised treatment for problem drinking using breaking Free Online Alcoholism Treatment Quarterly. 33, 2015: 185– 96.
  11. [19]Elison S, Humphreys L, Ward J, et al A pilot outcomes evaluation for computer assisted therapy for substance misuse—an evaluation of Breaking Free Online. Journal of Substance Use 2013; 19: 1– 6.
  12. [20]Elison S, Weston S, Davies G, et al Findings from mixed-methods feasibility and effectiveness evaluations of the “Breaking Free Online” treatment and recovery programme for substance misuse in prisons. Drugs: Education, Prevention and Policy 2015; 23: 1– 10.
  13. [21]Carroll KM, Rounsaville BJ Computer-assisted therapy in psychiatry: be brave—it's a new world. Curr Psychiatry Rep 2010; 12: 426– 32. 10.1007/s11920-010-0146-2 20683681 PMC2967758 · DOI
  14. [22]Olmstead TA, Ostrow CD, Carroll KM Cost-effectiveness of computer-assisted training in cognitive-behavioral therapy as an adjunct to standard care for addiction. Drug Alcohol Depend 2010; 110: 200– 7. 10.1016/j.drugalcdep.2010.02.022 20392575 PMC3033701 · DOI
  15. [24]Carroll KM, Integrity T Treatment integrity and dissemination: rethinking fidelity via the stage model. Clinical Psychology: Science and Practice 2013; 20: 99– 106.
  16. [25]Borrelli B, Sepinwall D, Ernst D, et al A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol 2005; 73: 852– 60. 10.1037/0022-006X.73.5.852 16287385 · DOI · Paper page
  17. [29]Donkin L, Christensen H, Naismith SL, et al A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res 2011; 13: e52 10.2196/jmir.1772 21821503 PMC3222162 · DOI · Paper page
  18. [32]Elison S, Ward J, Davies G, et al Implementation of computer-assisted therapy for substance misuse: a qualitative study of Breaking Free Online using Roger's diffusion of innovation theory. Drugs Alcohol Today 2014; 14: 207– 18. 10.1108/DAT-05-2014-0025 · DOI
  19. [33]Barnett J, Vasileiou K, Djemil F, et al Understanding innovators' experiences of barriers and facilitators in implementation and diffusion of healthcare service innovations: a qualitative study. BMC Health Serv Res 2011; 11: 342 10.1186/1472-6963-11-342 22176739 PMC3265424 · DOI
  20. [36]Andrewes H, Kenicer D, McClay C-A, et al A national survey of the infrastructure and IT policies required to deliver computerised cognitive behavioural therapy in the English NHS. BMJ Open 2013 3: e002277 10.1136/bmjopen-2012-002277 PMC3586111 23377995 · DOI
  21. [38]NICE. Computerised cognitive behaviour therapy for depression and anxiety review of technology.. London: National Institute for Health and Clinical Excellence 2009.
  22. [39]Beck AT Cognitive therapy: past, present, and future. J Consult Clin Psychol 1993; 61: 194– 8. 10.1037/0022-006X.61.2.194 8473571 · DOI · Paper page
  23. [40]Beck JS Cognitive behavior therapy: basics and beyond: Guilford Press, 2011.
  24. [41]Davies G, Elison S, Ward J, et al The role of lifestyle in perpetuating substance dependence: a new explanatory model, the Lifestyle Balance Model. Substance Abuse, Treatment, Prevention and Policy 2015; 10. PMC4326198 25595205
  25. [44]Craig P, Dieppe P, Macintyre S, et al Developing and evaluating complex interventions: the New Medical Research Council guidance. BMJ 2008; 337: a1655– a55.. 10.1136/bmj.a1655 18824488 PMC2769032 · DOI · Paper page
  26. [45]MacPherson H Pragmatic clinical trials. Complement Ther Med 2004; 12: 136– 40 https://doi.org/ 10.1016/j.ctim.2004.07.043 15561524 · DOI
  27. [48]Spitzer RL, Kroenke K, Williams JB, et al A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006; 166: 1092– 7. 10.1001/archinte.166.10.1092 16717171 · DOI · Paper page
  28. [50]Field A Discovering statistics using SPSS. Third Edition London: Sage, 2009.
  29. [51]Buckley PF Prevalence and consequences of the dual diagnosis of substance abuse and severe mental illness. J Clin Psychiatry 2006; 67 Suppl 7: 5– 9. 16961418
  30. [54]Lubelczyk R Detoxification or supervised withdrawal In: Trestman R, Appelbaum K, eds Oxford Textbook of Correctional Psychiatry. Oxford: oxford University Press, 2015.
  31. [55]Powell JE, Taylor D, Anger TD Anger, depression, and anxiety following heroin withdrawal. Int J Addict 1992; 27: 25– 35. 10.3109/10826089109063460 1537638 · DOI
  32. [56]Aguilar de Arcos F, Verdejo-García A, Ceverino A, et al Dysregulation of emotional response in current and abstinent heroin users: negative heightening and positive blunting. Psychopharmacology 2008; 198: 159– 66. 10.1007/s00213-008-1110-2 18330545 · DOI
  33. [58]Boydell KM, Hodgins M, Pignatiello A, et al Using technology to deliver mental health services to children and youth: a scoping review. J Can Acad Child Adolesc Psychiatry 2014; 23: 87-99. 24872824 PMC4032077
  34. [59]Ramsey AT, Montgomery K Technology-based interventions in social work practice: a systematic review of mental health interventions. Soc Work Health Care 2014; 53: 883– 99. 10.1080/00981389.2014.925531 25321935 PMC4214072 · DOI
  35. [61]Andersson G, Titov N Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry 2014; 13: 4– 11. 10.1002/wps.20083 24497236 PMC3918007 · DOI · Paper page
  36. [62]Bennion MR, Hardy G, Moore RK, et al E-therapies in England for stress, anxiety or depression: what is being used in the NHS? A survey of mental health services. BMJ Open 2017; 7: e014844 10.1136/bmjopen-2016-014844 PMC5278266 28115336 · DOI
  37. [63]Proudfoot J, Ryden C, Everitt B, et al Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry 2004; 185: 46– 54. 10.1192/bjp.185.1.46 15231555 · DOI · Paper page
  38. [65]Padian NS, McCoy SI, Balkus JE, et al Weighing the gold in the gold standard: challenges in HIV prevention research. AIDS 2010; 24: 621– 35. 10.1097/QAD.0b013e328337798a 20179575 PMC3695696 · DOI
  39. [67]Kaptchuk TJ The double-blind, randomized, placebo-controlled trial: gold standard or golden calf? J Clin Epidemiol 2001; 54: 541– 9. 11377113
  40. [68]Mohr DC, Schueller SM, Riley WT, et al Trials of intervention principles: evaluation methods for evolving Behavioral intervention Technologies. J Med Internet Res 2015; 17: e166 10.2196/jmir.4391 26155878 PMC4526981 · DOI · Paper page
  41. [69]Noar SM, Benac CN, Harris MS Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007; 133: 673– 93. 10.1037/0033-2909.133.4.673 17592961 · DOI · Paper page
  42. [72]Khadjesari Z, Murray E, Kalaitzaki E, et al Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials. J Med Internet Res 2011; 13: e26 10.2196/jmir.1523 21371988 PMC3221348 · DOI · Paper page
  43. [74]Gearing RE, Townsend L, Elkins J, et al Strategies to predict, measure, and improve psychosocial treatment adherence. Harv Rev Psychiatry 2014; 22: 31– 45. 10.1097/HRP.10.1097/HRP.0000000000000005 24394220 · DOI
  44. [76]Delgadillo J, McMillan D, Lucock M, et al Early changes, attrition, and dose–response in low intensity psychological interventions. Br J Clin Psychol 2014; 53: 114– 30. 10.1111/bjc.12031 24117962 · DOI
  45. [78]Wright JH, Wright AS, Albano AM, et al Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry 2005; 162: 1158-64 10.1176/appi.ajp.162.6.1158 15930065 · DOI · Paper page

Cited by

Sorted by citations

Authors
Elison, S., Ward, J., Williams, C., Espie, C., Davies, G., Dugdale, S., Ragan, K., Chisnall, L., Lidbetter, N., & Smith, K.
Affiliations
  • Breaking Free Group (United Kingdom) (GB)
  • University of Glasgow (GB)
  • University of Oxford (GB)
  • Self Help Services, UK
Corresponding author
Elison, Sarah
Venue
BMJ Open
Publisher
BMJ
Published
2017-07
Volume
7
Issue
7
Pages
e016392
ISSN
2044-6055 (ISSN-L)
OpenAlex
W2737654419
Cited by
33
References
26
Citations by year
2026: 1 · 2024: 3 · 2023: 3 · 2022: 5 · 2021: 7 · 2020: 6 · 2019: 4 · 2018: 3 · 2017: 1
FWCI
4.37
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion)
  • HighWire Press Open Archive (submittedVersion)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
Keywords
digital mental health interventions, community mental health services, depression, anxiety, insomnia, substance abuse, user engagement, feasibility, Greater Manchester
MeSH terms
Adult, Mental Disorders, Community Mental Health Services, Female, United Kingdom, Humans, Male, Mental Health, Middle Aged, Regression Analysis, Treatment Outcome, Internet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review