Qualitative Meta-Synthesis of User Experience of Computerised Therapy for Depression and Anxiety
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Computerised therapies play an integral role in efforts to improve access to psychological treatment for patients with depression and anxiety. However, despite recognised problems with uptake, there has been a lack of investigation into the barriers and facilitators of engagement. We aimed to systematically review and synthesise findings from qualitative studies of computerised therapies, in order to identify factors impacting on engagement. METHOD: Systematic review and meta-synthesis of qualitative studies of user experiences of computer delivered therapy for depression and/or anxiety. RESULTS: 8 studies were included in the review. All except one were of desktop based cognitive behavioural treatments. Black and minority ethnic and older participants were underrepresented, and only one study addressed users with a co-morbid physical health problem. Through synthesis, we identified two key overarching concepts, regarding the need for treatments to be sensitive to the individual, and the dialectal nature of user experience, with different degrees of support and anonymity experienced as both positive and negative. We propose that these factors can be conceptually understood as the 'non-specific' or 'common' factors of computerised therapy, analogous to but distinct from the common factors of traditional face-to-face therapies. CONCLUSION: Experience of computerised therapy could be improved through personalisation and sensitisation of content to individual users, recognising the need for users to experience a sense of 'self' in the treatment which is currently absent. Exploiting the common factors of computerised therapy, through enhancing perceived connection and collaboration, could offer a way of reconciling tensions due to the dialectal nature of user experience. Future research should explore whether the findings are generalisable to other patient groups, to other delivery formats (such as mobile technology) and other treatment modalities beyond cognitive behaviour therapy. The proposed model could aid the development of enhancements to current packages to improve uptake and support engagement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier reviews of qualitative studies of low‐intensity interventions (computerized and guided self‐help) found common themes that not enough time was spent discussing participants' specific problems and that interventions were not sufficiently individualized (Khan et al., 2007; Knowles et al., 2014).”
From Experiences of a transdiagnostic group, the Take Control Course, for clients with common mental health problems: A qualitative study (2018) · cites this paper as Knowles et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Personalization is consistently mentioned as one of the biggest advantages of digital solutions, but personalization, dynamic adjustment, and tailoring have not been realized with DMH tools thus far [15,43,50].”
From Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint (2019) · cites this paper as [43]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Positive experiences were also described, such as feeling empowered (Khan et al., 2007; Knowles et al., 2014).”
From Experiences of a transdiagnostic group, the Take Control Course, for clients with common mental health problems: A qualitative study (2018) · cites this paper as Knowles et al., 2014
The cited source says what the claim attributes to it.
In the citing paper
“Research suggests internet-administered, self-help interventions should be developed with the target population in mind,14 with lower levels of acceptability found for internet-administered interventions not developed for a specific population.15”
In the citing paper
“Variations in findings regarding benefits of human facilitation may reflect different health needs and preferences of users which, in turn, may vary depending on the types of intervention and facilitation offered.62”
From Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions (2016) · cites this paper as [62]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,997
Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-181 · Cited by 3,569 · cited 1×
“There remains a lack of formal consensus around the use of quality appraisals in qualitative reviews[25][26].”
BackgroundNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,289
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Talking about tactile experiences
Obrist, M., Seah, S. A., & Subramanian, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466220 · Cited by 1,613
Bower, P., & Gilbody, S. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.186.1.11 · Cited by 1,084 · cited 1×
“Such health technologies are described as ‘low intensity’ treatment in the UK, typically referring to self care interventions with minimal professional input[3].”
BackgroundSelf-citationConducting a meta-ethnography of qualitative literature: Lessons learnt
Atkins, S., Lewin, S., Smith, H., Engel, M., Fretheim, A., & Volmink, J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-21 · Cited by 981
Research works printed but not linked: 1
- Knowles SE, Lester H, Bower P, Lovell K, Gilbody S (2012) Patient experiences of computerised therapy in Primary Care: Qualitative findings from the REEACT Trial. Presented at the 2012 Conference for Primary Care Mental Health.
Cited by
Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118
“Variations in findings regarding benefits of human facilitation may reflect different health needs and preferences of users that, in turn, may vary depending on the types of intervention and facilitation offered.(62) Simple interventions that users are confident to implement without support may not benefit from additi…”
BackgroundHollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846
“Adults with experience of using computerised therapies reported a desire for DHIs to be responsive to the ‘self’ (e.g. sensitive to their clinical needs, feelings and personal preferences; Knowles et al., 2014).”
MethodMetasynthesis: An Original Method to Synthesize Qualitative Literature in Psychiatry
Lachal, J., Revah-Levy, A., Orri, M., & Moro, M. R. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00269 · Cited by 367
Pennant, M. E., Loucas, C. E., Whittington, C., Creswell, C., Fonagy, P., Fuggle, P., Kelvin, R., Naqvi, S., Stockton, S., & Kendall, T. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.01.009 · Cited by 269
“It is important that cCBT products are interactive, engaging and up-to-date with current technology, and give young people autonomy (NCCMH, 2014) and individualisation of therapy (Knowles et al., 2014).”
BackgroundPatel, S., Akhtar, A., Malins, S., Wright, N., Rowley, E., Young, E., Sampson, S., & Morriss, R. (2020) · Journal of Medical Internet Research · doi:10.2196/16228 · Cited by 190
Morton, K., Dennison, L., May, C., Murray, E., Little, P., McManus, R. J., & Yardley, L. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2016.10.019 · Cited by 195
Lipschitz, J., Miller, C. J., Hogan, T. P., Burdick, K. E., Lippin-Foster, R., Simon, S. R., & Burgess, J. (2019) · JMIR Mental Health · doi:10.2196/11334 · Cited by 183
“In addition, patients may be more likely to report severe symptoms on technology platforms than in person [12], and patients value the autonomy and empowerment that can be offered by such platforms [13].”
BackgroundHow to conduct a qualitative meta-analysis: Tailoring methods to enhance methodological integrity
Levitt, H. M. (2018) · Psychotherapy Research · doi:10.1080/10503307.2018.1447708 · Cited by 160
“, 2016), the training of psychotherapists (McGillivray, Gurtman, Boganin, & Sheen, 2015) and computerized psychotherapy (Knowles et al., 2014).”
BackgroundMethodTelemental health: A status update
Aboujaoude, E., Salame, W., & Naim, L. (2015) · World Psychiatry · doi:10.1002/wps.20218 · Cited by 154
“…levels of therapist intervention: standalone or unassisted cCBT generally refers to the independent use of a standardized, software-based treatment program that almost completely bypasses the therapist (5), whereas guided or assisted cCBT typically incorporates minimal therapist involvement (6-8).”
BackgroundScholten, H., & Granic, I. (2019) · Journal of Medical Internet Research · doi:10.2196/11528 · Cited by 138
“Personalization is consistently mentioned as one of the biggest advantages of digital solutions, but personalization, dynamic adjustment, and tailoring have not been realized with DMH tools thus far [15,43,50].”
InfluentialHughes-Morley, A., Young, B., Waheed, W., Small, N., & Bower, P. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.005 · Cited by 132
“, 2013) and depression (Beck, 2002; Khan et al., 2007; Knowles et al., 2014; Lamb et al., 2012; Gask et al., 2011; Malpass et al., 2009); however to our knowledge no study to date has addressed both.”
BackgroundSelf-citationCarolan, S., & de Visser, R. O. (2018) · JMIR Mental Health · doi:10.2196/mental.9146 · Cited by 121
“Knowles et al [34,35] identified similar contradictions in users’ experience of digital therapies in nonwork settings.”
Coventry, P. A., Small, N., Panagioti, M., Adeyemi, I., & Bee, P. (2015) · BMC Family Practice · doi:10.1186/s12875-015-0345-3 · Cited by 135
“This approach has been used by one of the authors (PB) in previous qualitative reviews [20] and has been successfully deployed in a previous meta-synthesis [19].”
MethodSelf-citationScholten, M. R., Kelders, S. M., & Van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7351 · Cited by 97
“This need is described by Knowles et al [28] as “sensitivity to ‘How I Feel’, recognizing the demands of depression on the user (such as emotional and motivational difficulties, and problems with concentration),” and reported on by Todd [32], “In terms of practical issues participants described…”
BackgroundInfluentialIntegrating Health Behavior Theory and Design Elements in Serious Games
Cheek, C., Fleming, T., Lucassen, M. F., Bridgman, H., Stasiak, K., Shepherd, M., & Orpin, P. (2015) · JMIR Mental Health · doi:10.2196/mental.4133 · Cited by 95
“Appealing to a user’s sense of self or agency and connectedness with others has been suggested to improve uptake and support engagement of computer-delivered therapies for depression and/or anxiety [14,15].”
Seiferth, C., Vogel, L., Aas, B., Brandhorst, I., Carlbring, P., Conzelmann, A., Esfandiari, N., Finkbeiner, M., Hollmann, K., Lautenbacher, H., et al. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00085-1 · Cited by 122
Meta-synthesis of qualitative research: the challenges and opportunities
Mohammed, M. A., Moles, R. J., & Chen, T. F. (2016) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-016-0289-2 · Cited by 146
“Psychiatry/mental health Qualitative meta-synthesis of user experience of computerised therapy for depression and anxiety [85]”
Predictors of Dropout in Internet-Based Cognitive Behavioral Therapy for Depression
Schmidt, I. D., Forand, N. R., & Strunk, D. R. (2019) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9979-5 · Cited by 92
Early Psychosis Service User Views on Digital Technology: Qualitative Analysis
Bucci, S., Morris, R., Berry, K., Berry, N., Haddock, G., Barrowclough, C., Lewis, S., & Edge, D. (2018) · JMIR Mental Health · doi:10.2196/10091 · Cited by 78
“This finding was also supported in a meta-synthesis review of experiences of computer-delivered therapy for people with depression and anxiety, whereby participants referred to the empowering nature of computerized therapy [36].”
Carter, D. D., Robinson, K., Forbes, J., & Hayes, S. (2018) · PLOS ONE · doi:10.1371/journal.pone.0208759 · Cited by 75
Søgaard Neilsen, A., & Wilson, R. L. (2019) · International Journal of Mental Health Nursing · doi:10.1111/inm.12527 · Cited by 71
Health Technologies 'In the Wild': Experiences of Engagement with Computerised CBT
Rennick-Egglestone, S., Knowles, S., Toms, G., Bee, P., Lovell, K., & Bower, P. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858128 · Cited by 68
“We have presented specific findings that complement prior work on user experiences of engagement with mental health technologies [23,24], and also documented issues of more general interest to healthcare technology design research, including the challenge of engaging and disengaging with health technologies, and the i…”
BackgroundResultInfluentialSelf-citationDewa, L. H., Lavelle, M., Pickles, K., Kalorkoti, C., Jaques, J., Pappa, S., & Aylin, P. P. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222655 · Cited by 79
The Current State and Validity of Digital Assessment Tools for Psychiatry: Systematic Review
Martin-Key, N. A., Spadaro, B., Funnell, E. L., Barker, E., Schei, T. S., Tomasik, J., & Bahn, S. (2021) · JMIR Mental Health · doi:10.2196/32824 · Cited by 71
Vilaza, G. N., & McCashin, D. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689736 · Cited by 60
“Research suggests that digital technologies to assist the CBT processes could improve access to psychological treatment (16).”
BackgroundFernández-Álvarez, J., Díaz-García, A., González-Robles, A., Baños, R., García-Palacios, A., & Botella, C. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.09.001 · Cited by 60
“Although many qualitative studies do examine client experiences from a qualitative perspective (e.g. Knowles et al., 2014), only few have posed the question on the experience of dropping out an IBT (e.g. Johansson et al., 2015).”
BackgroundKodish, T., Lau, A. S., Gong-Guy, E., Congdon, E. L., Arnaudova, I., Schmidt, M., Shoemaker, L., & Craske, M. G. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01163-1 · Cited by 69
“Although many have cited the potential of DMHI to reduce disparities, college students of color students remain underrepresented in the literature on digital mental health (Knowles et al., 2014).”
BackgroundHentati, A., Forsell, E., Ljótsson, B., Kaldo, V., Lindefors, N., & Kraepelien, M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100448 · Cited by 64
“…whether an improved UI is crucial for treatment engagement within digital mental health interventions (Andersson et al., 2009; Kelders et al., 2012; Knowles et al., 2014; Ludden et al., 2015; Nitsch et al., 2016; Bauer et al., 2018; Baumel and Kane, 2018; Wei et al., 2020; Yogarajah et al., 2020),…”
BackgroundPatient experiences of psychological therapy for depression: a qualitative metasynthesis
McPherson, S., Wicks, C., & Tercelli, I. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02682-1 · Cited by 52
Lemon, C. A., Huckvale, K., Carswell, K., & Torous, J. B. (2020) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462319003507 · Cited by 62
“Addressing poor UX can increase user satisfaction (7), while tailoring design to users ’ needs can improve treatment adherence and patient empowerment (8).”
BackgroundA meta-synthesis of elite athletes’ experiences in dual career development
Li, M., & Sum, R. K. W. (2017) · Asia Pacific Journal of Sport and Social Science · doi:10.1080/21640599.2017.1317481 · Cited by 81
“Second-order constructs were defined as interpretations of participants’ quotes expressed as themes, developed by the original researchers and summed up either in results or discussion parts of the original research (Knowles et al., 2014).”
BackgroundYim, S. H., & Schmidt, U. (2019) · International Journal of Eating Disorders · doi:10.1002/eat.23142 · Cited by 46
Tutorial for writing systematic reviews for the Brazilian Journal of Physical Therapy (BJPT)
Mancini, M. C., Cardoso, J. R., Sampaio, R. F., Costa, L. C. M., Cabral, C. M. N., & Costa, L. O. P. (2014) · Brazilian Journal of Physical Therapy · doi:10.1590/bjpt-rbf.2014.0077 · Cited by 60
Lovell, K., Bower, P., Gellatly, J., Byford, S., Bee, P., McMillan, D., Arundel, C., Gilbody, S., Gega, L., Hardy, G., et al. (2017) · Health Technology Assessment · doi:10.3310/hta21370 · Cited by 43
Self-citationSchröder, J., Berger, T., Meyer, B., Lutz, W., Späth, C., Michel, P., Rose, M., Hautzinger, M., Hohagen, F., Klein, J. P., et al. (2018) · Depression and Anxiety · doi:10.1002/da.22727 · Cited by 43
“…a number of qualitative oriented studies have been conducted on people's perceptions of Internet interventions (Fernández-Álvarez et al., 2017;Knowles et al., 2014; Lillevoll et al., 2013; Rennick-Egglestone et al., 2016), the findings have not been sufficiently transferred to quantitative…”
BackgroundBlended CBT versus face-to-face CBT: a randomised non-inferiority trial
Mathiasen, K., Andersen, T. E., Riper, H., Kleiboer, A. A. M., & Roessler, K. K. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1140-y · Cited by 42
Eis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 45
“Mobile health interventions can help promote self-care and empower patients [16] and thus avoid treatment limitations [17] and contribute to improvements in the symptoms and quality of life of people affected by depression and/or anxiety [18–21].”
BackgroundLenhard, F., Vigerland, S., Engberg, H., Hallberg, A., Thermaenius, H., & Serlachius, E. (2016) · PLOS ONE · doi:10.1371/journal.pone.0164311 · Cited by 37
Intellectual disability and computers in therapy: Views of service users and clinical psychologists
Vereenooghe, L., Gega, L., & Langdon, P. E. (2017) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2017-1-11 · Cited by 37
“, 2011; Gega, Smith, & Reynolds, 2013) and helping them feel empowered (Knowles et al., 2014).”
BackgroundMcCashin, D., Coyle, D., & O’Reilly, G. (2019) · Journal of Medical Internet Research · doi:10.2196/13540 · Cited by 42
“Although this was also a minor theme, young people commented on the sometimes broad content of tech-assisted CBT in addition to a small number of negative experiences—a finding echoed in the research on adult experiences [9].”
Self-citationKemmeren, L. L., van Schaik, A., Smit, J. H., Ruwaard, J., Rocha, A., Henriques, M., Ebert, D. D., Titzler, I., Hazo, J.-B., Dorsey, M., et al. (2019) · JMIR Mental Health · doi:10.2196/12707 · Cited by 36
Mathiasen, K., Andersen, T. E., Lichtenstein, M. B., Ehlers, L. H., Riper, H., Kleiboer, A., & Roessler, K. K. (2022) · Journal of Medical Internet Research · doi:10.2196/36577 · Cited by 34
“However, despite the evidence for the effect of guided iCBT, there is a need for increased therapist contact among some patient groups as well as a need to provide a treatment format, which is more compatible with, and thus easier to implement in, the existing health care services [21-24].”
Acceptability of Computerized Cognitive Behavioral Therapy for Adults: Umbrella Review
Treanor, C., Kouvonen, A. M., Lallukka, T. M., & Donnelly, M. (2021) · JMIR Mental Health · doi:10.2196/23091 · Cited by 44
“Second, the delivery of cCBT needs to take into account the contradictory presence of perceived benefits and drawbacks (eg, the option to self-select modules may be empowering and burdensome, and cCBT may be perceived as enhancing confidentiality and privacy or as an obstacle to meeting the need for face-to-face suppo…”
BackgroundMethodAn, J., Kwak, H., Qureshi, H. M., & Weber, I. G. (2021) · JMIR Formative Research · doi:10.2196/22313 · Cited by 43
“Arguably, the inflexibility of the traditional approach to public health campaigns [9] decreases campaign effectiveness by making the audience feel less engaged [10,11].”
BackgroundLundgren, J., Johansson, P., Jaarsma, T., Andersson, G., & Kärner Köhler, A. (2018) · Journal of Medical Internet Research · doi:10.2196/10302 · Cited by 33
Wikman, A., Kukkola, L., Börjesson, H., Cernvall, M., Woodford, J., Grönqvist, H., & von Essen, L. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9457 · Cited by 32
Bowie-DaBreo, D., Sas, C., Iles‐Smith, H., & Sünram‐Lea, S. I. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517498 · Cited by 49
“This echoes findings of a systematic review on computerized CBT indicating that high level of autonomy can be both empowering and demanding [54].”
Woodford, J., Wikman, A., Cernvall, M., Ljungman, G., Romppala, A., Grönqvist, H., & von Essen, L. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-023708 · Cited by 31
Doukani, A., van Dalen, R., Valev, H., Njenga, A., Sera, F., & Chibanda, D. (2021) · Global Mental Health · doi:10.1017/gmh.2021.3 · Cited by 31
“For example, the integration of digital technologies in mental health care may reduce the costs of delivering and accessing services, while also extending access in relation to time and location (Andersson and Titov, 2014; Knowles et al ., 2014).”
BackgroundLipschitz, J. M., Connolly, S. L., Miller, C. J., Hogan, T. P., Simon, S. R., & Burdick, K. E. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.083 · Cited by 30
Feather, J. S., Howson, M., Ritchie, L., Carter, P. D., Parry, D. T., & Koziol-McLain, J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5455 · Cited by 28
“For Web-based interventions, as called for by Knowles et al, “it is likely that more in-depth, observational data collection methods will be necessary to better capture user experience in [the] future” (p11) [32].”
O’Cathain, A., Drabble, S. J., Foster, A., Horspool, K., Edwards, L., Thomas, C., & Salisbury, C. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5879 · Cited by 36
“Other researchers have also identified the importance of continuity of the person delivering telehealth and their level of motivation during delivery [23,28-30].”
Haig‐Ferguson, A., Loades, M. E., Whittle, C., Read, R. K., Higson‐Sweeney, N., Beasant, L., Starbuck, J., & Crawley, E. M. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.12.003 · Cited by 36
“Conversely, some studies have not found privacy concerns to be a significant barrier (Knowles et al., 2014; Lundgren et al., 2018) and it may be that technical solutions, like text based interventions, could be a way to overcome such issues.”
BackgroundGaffney, H., Mansell, W., & Tai, S. (2020) · Digital Health · doi:10.1177/2055207620911580 · Cited by 26
“Digital interventions that offer greater interactivity, increased choice and control over content, and applicability to a range of psychological problems have the potential to increase acceptability and efficiency.(9) Continued and rapid advances in digital technology are now able to facilitate this vision.”
BackgroundMartin-Key, N. A., Spadaro, B., Schei, T. S., & Bahn, S. (2021) · Journal of Medical Internet Research · doi:10.2196/27132 · Cited by 33
“Further, research has demonstrated that individuals are more likely to report severe symptoms on technology platforms than to a health care professional (HCP) [14], and patients value the independence and empowerment that can be obtained via the use of a digital platform [15].”
Woodford, J., Farrand, P. A., Hagström, J., Hedenmalm, L., & von Essén, L. (2021) · JMIR Formative Research · doi:10.2196/22709 · Cited by 31
“In addition to placing fewer demands on parents of children treated for cancer, guided internet-administered LICBT may represent a solution to address individual-and provider-level barriers to access [42-44].”
BackgroundJonassaint, C. R., Gibbs, P., Belnap, B. H., Karp, J. F., Abebe, K. Z., & Rollman, B. L. (2017) · BJPsych Open · doi:10.1192/bjpo.bp.116.003657 · Cited by 35
“9 Given CCBT ’ s strong evidence base, low cost and scalability, this type of internet intervention has the potential to increase access to high-quality mental health treatment, particularly for underserved populations; however, few CCBT trials include Black and minority ethnic participants, 9 and…”
Jensen-Ryan, D., & German, L. (2018) · Science and Public Policy · doi:10.1093/scipol/scy032 · Cited by 33
Kodish, T., Schueller, S. M., & Lau, A. S. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2022.12.002 · Cited by 34
Jonassaint, C. R., Kang, C., Prussien, K. V., Yarboi, J., Sanger, M., Wilson, J. D., Castro, L. M. D., Shah, N., & Sarkar, U. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby107 · Cited by 28
“Internet-delivered cCBT has been proven effective in reducing depression and anxiety [30,31]; however, few CCBT trials have included nonwhite participants [32], and no studies have tested cCBT among adults with SCD.”
BackgroundOrdinary User Experiences at Work: A Study of Greenhouse Growers
Clemmensen, T., Hertzum, M., & Abdelnour-Nocera, J. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3386089 · Cited by 32
“However, some research addresses usability and UX in specific work domains, such as administration [9], health [53], manufacturing [45], and maritime work [27].”
BackgroundRacial Differences in the Effectiveness of Internet-Delivered Mental Health Care
Jonassaint, C. R., Belnap, B. H., Huang, Y., Karp, J. F., Abebe, K. Z., & Rollman, B. L. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05542-1 · Cited by 48
Sweeney, L., Moss-Morris, R. E., Czuber‐Dochan, W., & Norton, C. S. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00829-9 · Cited by 29
“Additionally, given that the majority of participants were white and female, and there is underrepresentation here, and more broadly of black, ethnic and older groups in computerised therapy interventions [45], further work is needed with a more diverse sample to understand generalisability of results.”
BackgroundInfluentialPedersen, M. K., Mohammadi, R., Mathiasen, K., & Elmose, M. (2020) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12665 · Cited by 28
Gellatly, J., Pedley, R., Molloy, C., Butler, J., Lovell, K., & Bee, P. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1238-x · Cited by 22
Self-citationDepressive symptoms and web user experience
Thielsch, M. T., & Thielsch, C. (2018) · PeerJ · doi:10.7717/peerj.4439 · Cited by 24
“…of online (self-)help appears as a promising approach in altering depressive symptoms and avoiding barriers of traditional offline-treatment (e.g., Knowles et al., 2014; Richards & Richardson, 2012), the present studies’ results may help to prevent possible difficulties in designing such online…”
ResultCho, Y., Kim, H., Seong, S., Park, K., Choi, J., Kim, M., Kim, D., & Jeon, H. J. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.06.031 · Cited by 23
Engdahl, P., Svedberg, P., & Bejerholm, U. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03386-w · Cited by 21
“A qualitative meta-synthesis concluded that acceptability relies on the sensitivity of the digital intervention to individual needs and preferences [32].”
BackgroundWalsh, S., Szymczyńska, P., Taylor, S. J., & Priebe, S. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.07.003 · Cited by 25
“It has been suggested that increasing the level of collaboration and connectedness may improve how supported and empowered patients feel but risks promoting passivity and increasing burden (Knowles et al., 2014).”
BackgroundInfluentialWalsh, S., Kaselionyte, J., Taylor, S. J. C., & Priebe, S. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1812-x · Cited by 19
Shkel, J., Green, G., Le, S., Kaveladze, B., Marcotte, V., Rushton, K., Nguyen, T., & Schueller, S. M. (2023) · JMIR Formative Research · doi:10.2196/46062 · Cited by 10
Finazzi, E., & MacBeth, A. M. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2650 · Cited by 22
Wols, A., Pingel, M., Lichtwarck‐Aschoff, A., & Granic, I. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102396 · Cited by 32
Ekström, V., & Johansson, M. (2019) · Addiction Science & Clinical Practice · doi:10.1186/s13722-019-0173-1 · Cited by 22
Bragesjö, M., Arnberg, F. K., Jelbring, A., Nolkrantz, J., Särnholm, J., Lauri, K. O., von Below, C., & Andersson, E. (2021) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.1885193 · Cited by 18
“Previous research on other internet-delivered interventions has found therapist support to be an important factor as well (Holst et al., 2017; Knowles et al., 2014; Rozental et al., 2020) and meta-analytic work have shown that guided internet-delivered interventions in general report better effect…”
Thiblin, E., Woodford, J., Reuther, C., Lundgren, J., Lutvica, N., & von Essén, L. (2022) · Cancer Medicine · doi:10.1002/cam4.5377 · Cited by 18
Hales, S. A., & Fossey, J. (2017) · Aging & Mental Health · doi:10.1080/13607863.2017.1348475 · Cited by 20
“A number of factors have been identi fi ed which may improve user experience and engagement in cCBT packages, such as personalisation and sensitisation of content to speci fi c users (Knowles et al., 2014), and programmes need to be designed incorporating features which enhance these factors.”
BackgroundWoodford, J., Wikman, A., Einhorn, K., Cernvall, M., Grönqvist, H., Romppala, A., & von Essén, L. (2018) · JMIR Mental Health · doi:10.2196/10085 · Cited by 17
Sapkota, D., Baird, K. M., Saito, A., Rijal, P., Pokharel, R., & Anderson, D. J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0230069 · Cited by 20
“Qualitative studies are a useful way of exploring participants’ experiences of interventions and have often been used to understand the acceptability and engagement with those interventions [21].”
BackgroundDoukani, A., Free, C., Michelson, D., Araya, R., Montero‐Marín, J., Smith, S. C., Pashoja, A. C., & Kakuma, R. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036299 · Cited by 19
Stone, L., & Waldron, R. (2019) · Australian Journal of General Practice · doi:10.31128/ajgp-11-18-4760 · Cited by 21
Hadjistavropoulos, H. D., Chadwick, C., Beck, C. D., Edmonds, M., Sundström, C., Edwards, W., Ouellette, D., Waldrop, J., Adlam, K., Bourgeault, L., et al. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100474 · Cited by 17
“It is estimated that 80% of those with problematic alcohol misuse do not seek treatment (Kohn et al., 2004), with women less likely to receive treatment than men (McCrady et al., 2020).”
BackgroundJohnsen, H. M., & Haddeland, K. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100389 · Cited by 19
“For an evaluation of information systems, eight to ten participants may provide sufficient data if the participants selected are representative of the target users of the system being assessed (Kushniruk and Patel, 2004).”
BackgroundYarwood, B., Taylor, R., & Angelakis, I. (2024) · Community Mental Health Journal · doi:10.1007/s10597-023-01196-w · Cited by 14
“Similar findings were identified in earlier study by Knowles et al. (2014), in which it was concluded that computerised therapy could be improved through personalisation of its content to better support individual users.”
Chamberlain, L. R., Hall, C. L., Andrén, P., Davies, E. B., Kilgariff, J., Kouzoupi, N., Murphy, T. L., & Hollis, C. P. (2020) · JMIR Mental Health · doi:10.2196/19600 · Cited by 13
“This was important as it seems that patients prefer iCBTs that are sensitive to their needs [10].”
Intention to Use a Mental Health App for Menopause: Health Belief Model Approach
Martin-Key, N. A., Funnell, E. L., Benáček, J., Spadaro, B., & Bahn, S. (2024) · JMIR Formative Research · doi:10.2196/60434 · Cited by 19
“Additionally, evidence suggests that individuals are more inclined to disclose severe symptoms on technology platforms than to a health care professional (HCP) [17], and patients appear to value the autonomy and empowerment gained through the use of digital platforms [18].”
BackgroundMartin-Key, N. A., Schei, T. S., Barker, E., Spadaro, B., Funnell, E. L., Benáček, J., Tomasik, J., & Bahn, S. (2020) · JMIR Research Protocols · doi:10.2196/25382 · Cited by 14
“Studies have revealed the acceptability and efficacy of digital platforms for improving the reach, quality, and impact of mental health care [8], and patients have been found to value the ease of access and empowerment that can be obtained via the use of a digital platform [9].”
BackgroundSmart, K., Smith, L., Harvey, K., & Waite, P. (2021) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-021-01903-6 · Cited by 16
“[25] identified two themes: first, that the programme needed to be sensitive to the user as an individual (e.”
BackgroundResultRondung, E., Humphries, S., Olsson, E. M. G., Sundelin, R., Norlund, F., Held, C., Spaak, J., Tornvall, P., & Lyngå, P. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100562 · Cited by 13
“Given that our participants asked for more personal support rather than less, we believe that the positive consequences of support are likely to outweigh negative ones, even though both viewpoints might co-occur in the participant group (Knowles et al., 2014).”
Coyle, D., Thieme, A., Linehan, C., Balaam, M., Wallace, J., & Lindley, S. E. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.05.008 · Cited by 15
Self-citationKlein, C. S., Alt, A. K., Pascher, A., Kühnhausen, J., Seizer, L., Ilg, W., Thierfelder, A., Primbs, J., Menth, M., Barth, G. M., et al. (2024) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-024-00844-7 · Cited by 12
Doukani, A., Pashoja, A. C., Fanaj, N., Qirjako, G., Meksi, A., Mustafa, S., Vis, C., & Hug, J. (2021) · JMIR Formative Research · doi:10.2196/29280 · Cited by 20
Pilot study of psychotherapeutic text messaging for depression
Pfeiffer, P. N., Henry, J., Ganoczy, D. A., & Piette, J. D. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16659955 · Cited by 11
Seaton, N., Moss-Morris, R. E., Hulme, K., Macaulay, H., & Hudson, J. L. (2023) · BJPsych Open · doi:10.1192/bjo.2023.519 · Cited by 13
“Participants finding remote therapy convenient is heavily supported by the literature; 41 however, a meta-synthesis investigating digital therapy for adults with depression, anxiety and/or somatoform disorders has, like ours, found that some patients feel they require face-to-face contact to engage…”
Chen, A., Swaminathan, A., Kearns, W. R., Alberts, N. M., Law, E. F., & Palermo, T. M. (2019) · Journal of Medical Internet Research · doi:10.2196/11756 · Cited by 13
Langergaard, A., Mathiasen, K., Søndergaard, J., Sørensen, S. S., Laursen, S. L., Xylander, A. A. P., Lichtenstein, M. B., & Ehlers, L. H. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100513 · Cited by 10
“To the best of the researchers' knowledge, only one pilot study has investigated the cost-effectiveness of B-CBT compared to S-CBT (Kooistra et al., 2019).”
BackgroundTsoi, E. W. S., Mak, W. W. S., Ho, C. Y. Y., & Yeung, G. T. Y. (2022) · JMIR Human Factors · doi:10.2196/35057 · Cited by 13
“These contradictory findings are broadly consistent with the findings from previous meta-synthesis [36] that proposed 2 critical system characteristics to address the competing needs of users.”
Levis, M., Levy, J., Dimambro, M., Dufort, V., Ludmer, D. J., Goldberg, M., & Shiner, B. R. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116097 · Cited by 13
Andersson, R., Vigerland, S., Åhlén, J., Widström, H., Unger, I., Serlachius, E., & Engberg, H. (2023) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-023-02142-7 · Cited by 11
“The importance of identification has been reported in a previous systematic review of studies on adult experiences of ICBT [25].”
BackgroundTowards thriving: extending computerised cognitive behavioural therapy
Wilson, C., DRAPER, S. W., Brereton, M. F., & Johnson, D. M. (2017) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3152771.3152802 · Cited by 10
“Thus, from a Positive Psychology perspective, we suggest there is value in proactively addressing the mental health needs of non-clinical populations i.e. those with no diagnosed mental health conditions, as this may theoretically support greater mental resilience, strength and wellbeing in society.”
BackgroundInfluential
Metadata
- Authors
- Knowles, S. E., Toms, G., Sanders, C., Bee, P., Lovell, K., Rennick-Egglestone, S., Coyle, D., Kennedy, C. M., Littlewood, E., Kessler, D., Gilbody, S., & Bower, P.
- Affiliations
- University of Manchester (GB)
- University of Bristol (GB)
- University of Birmingham (GB)
- University of York (GB)
- Corresponding author
- Knowles, Sarah E.
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-17
- Volume
- 9
- Issue
- 1
- Pages
- e84323
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3894944
- OpenAlex
- W2142042982
- Cited by
- 177
- References
- 49
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 12 · 2023: 13 · 2022: 13 · 2021: 28 · 2020: 18 · 2019: 14 · 2018: 23 · 2017: 14 · 2016: 12 · 2015: 5 · 2014: 3
- FWCI
- 17.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Repository@Nottingham (University of Nottingham) (publishedVersion, cc-by)
- Research Explorer (The University of Manchester) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Nottingham ePrints (University of Nottingham) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- National Institute for Health and Care Research (SPCR-040, 06/43/504, HTA/06/43/504, 06/43/05)
- NIHR School for Primary Care Research
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- depression, anxiety, user experience, treatment engagement, barriers and facilitators, common factors, non-specific factors, cognitive behavioral therapy, personalization, anonymity, selfhood, access to psychological treatment
- MeSH terms
- Anxiety, Depression, Humans, Therapy, Computer-Assisted
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

