Adherence to e-mental health among youth: Considerations for intervention development and research design
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
E-mental health programmes have great potential to provide young people with access to mental health support. However, it is commonly reported that adherence to these programmes is low. Low adherence can be problematic, particularly if young people do not receive the full benefits of a programme. In a research trial setting, non-adherence to treatment recommendations can prevent researchers from drawing strong conclusions about effectiveness. Although adherence has been recognised as an issue in need of attention, many of the reviews available are focused on adults and lack clear direction towards what strategies to employ. This paper presents a broad review of the adherence literature, focusing on factors associated with improving adherence to e-mental health among youth. Our view on the key elements to improve adherence identified from the existing literature are presented, and key recommendations for e-mental health intervention design are provided. These include: developing and communicating adherence guidelines based on individuals’ needs and symptom severity, including customisable features to provide a tailored experience and promote a sense of agency, including engagement checks and adopting a user-centred approach by utilising strategies such as co-design. This paper provides guidance to intervention designers and researchers by outlining recommendations and considerations for intervention development and research design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 2×
“offering choice flexibility(48) may ensure that reminders and notifications are received at actionable times of the day and are not intrusive.(49) Programme designers might also consider enabling users to opt out of reminders and notifications,(48) especially giventhese features may not be useful to promote self-direc…”
BackgroundMohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 5×
“In line with this, Mohr et al.38 suggested that in order to avoid the potential negative effects of rigid adherence guidelines, it may be useful to involve participants in the process of setting usage and interaction goals for their treatment.”
BackgroundInfluentialThe impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846
Mohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · cited 1×
“Intervention designers may also consider whether it is appropriate to provide guidance to support and monitor participants’ adherence and reinforce participants’ accountability.(38,40,61) Digital treatments can be utilised in a number of different ways, including as a purely self-directed treatment programme, treatmen…”
BackgroundThe impact of digital technology on psychological treatments and their dissemination
Fairburn, C. G., & Patel, V. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.08.012 · Cited by 448 · cited 2×
“This method of support may also be cost-effective and efficient for consumers and therapists.(62,63) However, more research has been recommended to understand how this method is implemented,(62) including considering the varying needs of different populations such as young people.”
BackgroundGarrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400
A systematic review of online youth mental health promotion and prevention interventions
Clarke, A. M., Kuosmanen, T., & Barry, M. M. (2015) · Journal of Youth and Adolescence · doi:10.1007/s10964-014-0165-0 · Cited by 381 · cited 4×
“Their capacity to be delivered at scale also offers an opportunity to reach more young people in the prevention of mental illness, and early detection and intervention.(9) While there is promising evidence to”
BackgroundInfluentialMohr, D. C., Weingardt, K. R., Reddy, M., & Schueller, S. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600541 · Cited by 365
Titov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., Spence, J., McEvoy, P. M., & Rapee, R. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062873 · Cited by 364 · cited 1×
“To assist users in understanding their expectations for effective engagement, designers can consider embedding a section in the onboarding process that outlines the recommended use to experience a beneficial effect and asks users to agree to it or to input what they think is achievable.(33,38,44)”
BackgroundBeatty, L., & Binnion, C. (2016) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9556-9 · Cited by 347
Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8578 · Cited by 331 · cited 4×
“Sieverink et al.25 argued that the amount of activity completed within a programme is simply a measure of attendance, whereas adherence should reflect compliance with the recommended and intended use of a programme.”
BackgroundInfluentialCalear, A. L., Christensen, H., Mackinnon, A., Griffiths, K. M., & O'Kearney, R. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0017391 · Cited by 327
Towards a consensus around standards for smartphone apps and digital mental health
Torous, J., Andersson, G., Bertagnoli, A., Christensen, H., Cuijpers, P., Firth, J., Haim, A., Hsin, H., Hollis, C., Lewis, S., et al. (2019) · World Psychiatry · doi:10.1002/wps.20592 · Cited by 325
Burgess, P. M., Pirkis, J. E., Slade, T. N., Johnston, A. K., Meadows, G. N., & Gunn, J. M. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902970858 · Cited by 318 · cited 1×
“Despite this, more than three-quarters of youth with poor mental health do not seek professional care.(3) Delivering psychotherapy through e-mental health interventions can overcome many of the barriers that inhibit seeking help.”
BackgroundInvesting in youth mental health is a best buy
McGorry, P. D., Purcell, R., Hickie, I. B., & Jorm, A. F. (2007) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01326.x · Cited by 304
Grist, R., Croker, A., Denne, M., & Stallard, P. (2019) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-018-0271-8 · Cited by 287 · cited 1×
“A recent review examining the effectiveness of e-mental health interventions for young people identified that all programmes failed to use or report Participatory Design methods.(10) Ignoring the end user or assuming what they need may result in programme designers inadvertently including features that are: mismatched…”
BackgroundOnline randomized controlled trial of brief and full cognitive behaviour therapy for depression
CHRISTENSEN, H., GRIFFITHS, K. M., MACKINNON, A. J., & BRITTLIFFE, K. (2006) · Psychological Medicine · doi:10.1017/s0033291706008695 · Cited by 249 · cited 2×
“However, experimental research is needed to examine whether design and service elements affect adherence rates(26) and to understand the effect of different doses of treatment.(69) To attempt to understand what the active elements are of online interventions, researchers can consider alternative study designs to the R…”
BackgroundDoherty, G., Coyle, D., & Sharry, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208602 · Cited by 198 · cited 2×
“Incorporating features that enable personalisation can create a sense of ownership and agency over one’s treatment and content, allowing users to explore the modules that suit their needs and preferences.(28,47) Batterham et al.”
BackgroundDonkin, L., Hickie, I. B., Christensen, H., Naismith, S. L., Neal, B., Cockayne, N. L., & Glozier, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2771 · Cited by 193
Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M., & Andrews, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.001 · Cited by 193 · cited 2×
“Delivering personalised interventions includes tailoring content specific to individuals’ symptom profile(45,46) or the individual’s level of severity,(8) allowing participants to select the order of module completion or the choice of session scheduling with customised reminders.(26) Incorporating features that enable…”
BackgroundArtificial Intelligence-Assisted Online Social Therapy for Youth Mental Health
D'Alfonso, S., Santesteban-Echarri, O., Rice, S., Wadley, G., Lederman, R., Miles, C., Gleeson, J., & Alvarez-Jimenez, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00796 · Cited by 192 · cited 1×
“computational methods, including chatbot technologies, to be utilised in interventions as an adjunct or alternative to human support.(64) Employing data-driven methods can also help to ensure resources such as face-to-face help are utilised efficiently.”
MethodDesign and evaluation guidelines for mental health technologies
Doherty, G., Coyle, D., & Matthews, M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.006 · Cited by 179
Clarke, G., Kelleher, C., Hornbrook, M., DeBar, L., Dickerson, J., & Gullion, C. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802675353 · Cited by 154 · cited 2×
“However, in a sample of young adults using a selfdirected online programme, Clarke et al.34 found an inverse relationship between programme usage and outcome; that is, fewer page visits and less time online were associated with a greater reduction in depressive symptoms.”
BackgroundNeil, A. L., Batterham, P., Christensen, H., Bennett, K., & Griffiths, K. M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1050 · Cited by 152 · cited 1×
“Asking participants to report reasons for non-use is also important for uncovering new factors and learning how to address these.(23) Much of what is currently understood regarding factors that may improve adherence is based on predictive modelling.”
Backgroundvan der Zanden, R., Kramer, J., Gerrits, R., & Cuijpers, P. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2033 · Cited by 152
Lillevoll, K. R., Vangberg, H. C. B., Griffiths, K. M., Waterloo, K., & Eisemann, M. R. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-14 · Cited by 150 · cited 1×
“Programme designers might also consider enabling users to opt out of reminders and notifications,(48) especially giventhese features may not be useful to promote self-directed use in young people.(17) However, more research has been recommended in this area in order to understand whether reminders are beneficial.”
BackgroundPihlaja, S., Stenberg, J.-H., Joutsenniemi, K., Mehik, H., Ritola, V., & Joffe, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.11.005 · Cited by 134 · cited 1×
“Currently, research on the effects of alliance on adherence in e-mental health programmes is scarce.(70,71) However, one study demonstrated a positive relationship between perceived emotional connection with the programme (myCompass) and number of logins, psychoeducation modules completed and frequency of self-monitor…”
BackgroundKleiboer, A., Smit, J., Bosmans, J., Ruwaard, J., Andersson, G., Topooco, N., Berger, T., Krieger, T., Botella, C., Baños, R., et al. (2016) · Trials · doi:10.1186/s13063-016-1511-1 · Cited by 133 · cited 2×
“This method of support may also be cost-effective and efficient for consumers and therapists.(62,63) However, more research has been recommended to understand how this method is implemented,(62) including considering the varying needs of different populations such as young people.”
BackgroundManicavasagar, V., Horswood, D., Burckhardt, R., Lum, A., Hadzi-Pavlovic, D., & Parker, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3176 · Cited by 131
Kelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105 · cited 1×
“To attempt to understand what the active elements are of online interventions, researchers can consider alternative study designs to the RCT such as the multiphase optimisation strategy (MOST) methodology or a fractional factorial design.(27) Investigating young people’s treatment expectations and their desired outcom…”
Adherence to the MoodGYM program: outcomes and predictors for an adolescent school-based population
Calear, A. L., Christensen, H., Mackinnon, A., & Griffiths, K. M. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.11.036 · Cited by 105
Anderson, R. E. E., Spence, S. H., Donovan, C. L., March, S., Prosser, S., & Kenardy, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1848 · Cited by 102
Andersson, G., Estling, F., Jakobsson, E., Cuijpers, P., & Carlbring, P. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.529457 · Cited by 102 · cited 1×
“Other researchers have suggested that allowing users to choose modules freely may increase participants’ self-efficacy.(46) Further research measuring factors that might influence participants’ self-efficacy is needed, given its relationship with self-efficacy and adherence in health research.”
BackgroundWildeboer, G., Kelders, S. M., & van Gemert-Pijnen, J. E. W. C. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.04.005 · Cited by 98 · cited 1×
“The Persuasive Systems Design (PSD) framework has been applied to conceptualise the various components in online psychological therapies that might influence individuals’ attitudes or behaviour.(22) In this context, PSD features are often utilised in programmes to facilitate adherence.”
MethodThe association between adherence and outcome in an Internet intervention for depression
Fuhr, K., Schröder, J., Berger, T., Moritz, S., Meyer, B., Lutz, W., Hohagen, F., Hautzinger, M., & Klein, J. P. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.12.028 · Cited by 97 · cited 1×
“in traditional therapy such as the therapeutic alliance, an individual’s level of motivation and need for treatment care.(31,47) Measuring such factors can shed light on how the therapeutic dose may differ among participants, as well as what the unintended side effects may be.”
BackgroundWozney, L., Huguet, A., Bennett, K., Radomski, A. D., Hartling, L., Dyson, M., McGrath, P. J., & Newton, A. S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7573 · Cited by 93 · cited 3×
“Reduction strategies such as minimising the length and wordiness of modules are related to higher adherence.(50) However, evidence on the effectiveness of tunnelling is unclear.”
BackgroundInfluentialClarke, J., Proudfoot, J., Whitton, A., Birch, M.-R., Boyd, M., Parker, G., Manicavasagar, V., Hadzi-Pavlovic, D., & Fogarty, A. (2016) · JMIR Mental Health · doi:10.2196/mental.4656 · Cited by 86 · cited 1×
“However, one study demonstrated a positive relationship between perceived emotional connection with the programme (myCompass) and number of logins, psychoeducation modules completed and frequency of self-monitoring.(72)”
Whitton, A. E., Proudfoot, J., Clarke, J., Birch, M.-R., Parker, G., Manicavasagar, V., & Hadzi-Pavlovic, D. (2015) · JMIR Mental Health · doi:10.2196/mental.3573 · Cited by 69 · cited 1×
“Incorporating features that enable personalisation can create a sense of ownership and agency over one’s treatment and content, allowing users to explore the modules that suit their needs and preferences.(28,47) Batterham et al.”
BackgroundJeminiwa, R. N., Hohmann, N. S., & Fox, B. I. (2019) · The Journal of Pediatric Pharmacology and Therapeutics · doi:10.5863/1551-6776-24.4.254 · Cited by 69 · cited 1×
“This co-design process is also important, as young people are digital natives and may have preferences that are different from those of adult users.(59) Finally, it is important for researchers to consider carefully the unique e-mental health needs and preferences of all young people and to ensure that disadvantaged a…”
BackgroundA web-based adolescent positive psychology program in schools: randomized controlled trial
Burckhardt, R., Manicavasagar, V., Batterham, P. J., Miller, L. M., Talbot, E., & Lum, A. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4329 · Cited by 67 · cited 2×
“For example, Burckhardt et al.16 found that after converting an unstructured free-to-use programme to a structured school-based programme, the positive effects on mental health outcomes were not observed.”
Batterham, P. J., Calear, A. L., Farrer, L., McCallum, S. M., & Cheng, V. W. S. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.08.002 · Cited by 48 · cited 2×
“Batterham et al.(45) found some indication that a tailored intervention designed for youth was related to slightly better adherence compared to a static intervention, although these findings were not significant.”
ResultLee, P., Zehgeer, A., Ginsburg, G. S., McCracken, J., Keeton, C., Kendall, P. C., Birmaher, B., Sakolsky, D., Walkup, J., Peris, T., et al. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1310046 · Cited by 48
Farrer, L. M., Griffiths, K. M., Christensen, H., Mackinnon, A. J., & Batterham, P. J. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-013-9589-1 · Cited by 47
Cited by
Lehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488
Witarto, B. S., Visuddho, V., Witarto, A. P., Bestari, D., Sawitri, B., Melapi, T. A. S., & Wungu, C. D. K. (2022) · PLOS ONE · doi:10.1371/journal.pone.0274177 · Cited by 89
Ludlow, K., Russell, J. K., Ryan, B., Brown, R. L., Joynt, T., Uhlmann, L. R., Smith, G. E., Donovan, C., Hides, L., Spence, S. H., et al. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231216410 · Cited by 42
“30 Achilles et al. argued that customisation enables young people to have ownership and agency over their treatment 36 and Gardio et al. ’ s systematic review of digital mental health interventions for depression and anxiety in young people identi fi ed a lack of customisation as a “ dis-liked ”…”
BackgroundGeirhos, A., Domhardt, M., Lunkenheimer, F., Temming, S., Holl, R. W., Minden, K., Warschburger, P., Meissner, T., Mueller-Stierlin, A. S., & Baumeister, H. (2022) · BMC Pediatrics · doi:10.1186/s12887-022-03134-3 · Cited by 37
Patterson, V. C., Rossi, M. A., Pencer, A., & Wozney, L. (2022) · JMIR Formative Research · doi:10.2196/33374 · Cited by 11
“Current guidelines for digital mental health interventions strongly suggest using a co-design process [41,42], and the”
Metadata
- Authors
- Achilles, M. R., Anderson, M., Li, S. H., Subotic-Kerry, M., Parker, B., & O’Dea, B.
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2020-01
- Volume
- 6
- Pages
- 2055207620926064-2055207620926064
- ISSN
- 2055-2076 (ISSN-L)
- OpenAlex
- W3028582375
- Cited by
- 80
- References
- 46
- FWCI
- 8.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.