Toward the Design of Evidence-Based Mental Health Information Systems for People With Depression: A Systematic Literature Review and Meta-Analysis

Wahle, Fabian; Bollhalder, Lea; Kowatsch, Tobias; Fleisch, Elgar

doi:10.2196/jmir.7381

Cited by 49Digital Mental Health InterventionsMobile Health and mHealth ApplicationsAnxiety, Depression, Psychometrics, Treatment, Cognitive Processes

Toward the Design of Evidence-Based Mental Health Information Systems for People With Depression: A Systematic Literature Review and Meta-Analysis

Open access

Wahle, Fabian, Bollhalder, Lea, Kowatsch, Tobias, Fleisch, Elgar·2017·Journal of Medical Internet Research

DOI 10.2196/jmir.7381PMC PMC5471345

Open this paper in CoChat — free account

Abstract

BACKGROUND: Existing research postulates a variety of components that show an impact on utilization of technology-mediated mental health information systems (MHIS) and treatment outcome. Although researchers assessed the effect of isolated design elements on the results of Web-based interventions and the associations between symptom reduction and use of components across computer and mobile phone platforms, there remains uncertainty with regard to which components of technology-mediated interventions for mental health exert the greatest therapeutic gain. Until now, no studies have presented results on the therapeutic benefit associated with specific service components of technology-mediated MHIS for depression. OBJECTIVE: This systematic review aims at identifying components of technology-mediated MHIS for patients with depression. Consequently, all randomized controlled trials comparing technology-mediated treatments for depression to either waiting-list control, treatment as usual, or any other form of treatment for depression were reviewed. Updating prior reviews, this study aims to (1) assess the effectiveness of technology-supported interventions for the treatment of depression and (2) add to the debate on what components in technology-mediated MHIS for the treatment of depression should be standard of care. METHODS: Systematic searches in MEDLINE, PsycINFO, and the Cochrane Library were conducted. Effect sizes for each comparison between a technology-enabled intervention and a control condition were computed using the standard mean difference (SMD). Chi-square tests were used to test for heterogeneity. Using subgroup analysis, potential sources of heterogeneity were analyzed. Publication bias was examined using visual inspection of funnel plots and Begg's test. Qualitative data analysis was also used. In an explorative approach, a list of relevant components was extracted from the body of literature by consensus between two researchers. RESULTS: Of 6387 studies initially identified, 45 met all inclusion criteria. Programs analyzed showed a significant trend toward reduced depressive symptoms (SMD -0.58, 95% CI -0.71 to -0.45, P<.001). Heterogeneity was large (I2≥76). A total of 15 components were identified. CONCLUSIONS: Technology-mediated MHIS for the treatment of depression has a consistent positive overall effect compared to controls. A total of 15 components have been identified. Further studies are needed to quantify the impact of individual components on treatment effects and to identify further components that are relevant for the design of future technology-mediated interventions for the treatment of depression and other mental disorders.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.2196/jmir.7381

Cites

141 of 141 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Mental health app interventions are moderately effective in reducing depressive symptoms compared to controls, consistent with prior meta-analyses.
“Consistent with prior systematic reviews and meta-analyses on digital interventions for depression, we found that mental health app interventions are moderately effective in reducing depressive symptoms compared to controls [26,37,38,41,89].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [38]
The Results (Synthesis of Results: Impact on Symptoms of Depression; page unavailable) report a moderate reduction in depressive symptoms across 45 trials of technology-based interventions, compared with controls as described in Methods (Statistical Analyses). But the Discussion (Principal Results; page unavailable) says 42 of the 45 trials did not use mobile phones or tablets, so the pooled finding does not establish a moderate effect specifically for app interventions. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Another meta-analysis of 45 randomized controlled trials found that depressive symptoms showed significant reductions compared to wait-list or treatment-as-usual controls.
“Depressive symptoms showed significant reductions in comparison to either wait-list or treatment-as-usual controls [38].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [38]
Incorporating reminders into digital mental health interventions can promote engagement and adherence, which may enhance therapeutic benefits.
“Other work suggests that incorporating reminders into digital mental health interventions can promote engagement and adherence with the intervention, which may, in turn, enhance the intervention’s therapeutic benefits [38].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [38]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

1 retracted

Psychological interventions for overweight or obesity
Shaw, K. A., O'Rourke, P., Del Mar, C., & Kenardy, J. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003818.pub2 · Cited by 442 · see citing works
Retracted
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · see citing works
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · see citing works
The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
The “Golden Age” of Probiotics: A Systematic Review and Meta-Analysis of Randomized and Observational Studies in Preterm Infants
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · see citing works
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
Aspirin plus Clopidogrel as Secondary Prevention after Stroke or Transient Ischemic Attack: A Systematic Review and Meta-Analysis
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2014) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,609 · see citing works
The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Selective Cortical Undercutting As a Means of Modifying and Studying Frontal Lobe Function in Man
Scoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,373 · see citing works
What Is Value in Health Care?
Porter, M. E. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1011024 · Cited by 5,084 · see citing works
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,832 · see citing works
Efficacy and Safety of Tadalafil Monotherapy for Lower Urinary Tract Symptoms Secondary to Benign Prostatic Hyperplasia: A Meta-Analysis
Dong, Y., Hao, L., Shi, Z., Wang, G., Zhang, Z., & Han, C. (2013) · Urologia Internationalis · doi:10.1159/000351405 · Cited by 4,557 · see citing works
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · see citing works
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445 · cited 1× · see citing works
“These included (1) psychotherapy (eg, cognitive behavioral therapy [22], interpersonal therapy [23], problem-solving therapy [24], supportive therapy [25]), (2) psychoeducation [26], and (3) exercise/physical activity [27] which showed results on par with a pharmacological treatment.”
Background
The Law of Attrition
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · see citing works
Using the Internet to Promote Health Behavior Change: A Systematic Review and Meta-analysis of the Impact of Theoretical Basis, Use of Behavior Change Techniques, and Mode of Delivery on Efficacy
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · see citing works
Design Thinking
Rowe, P. G. (1987) · Cited by 2,481 · see citing works
Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136 · see citing works
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-Analysis
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311 · see citing works
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · see citing works
A Comprehensive Review and a Meta-Analysis of the Effectiveness of Internet-Based Psychotherapeutic Interventions
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · see citing works
Physical activity, exercise, depression and anxiety disorders
Ströhle, A. (2009) · Journal of Neural Transmission · doi:10.1007/s00702-008-0092-x · Cited by 1,269 · see citing works
Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions
The IMAGE Study Group, Greaves, C. J., Sheppard, K. E., Abraham, C., Hardeman, W., Roden, M., Evans, P. H., & Schwarz, P. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-119 · Cited by 1,163 · see citing works
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · see citing works
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · see citing works
The positive effects of cognitive–behavioral programs for offenders: a meta-analysis of factors associated with effective treatment
Landenberger, N. A., & Lipsey, M. W. (2005) · Journal of Experimental Criminology · doi:10.1007/s11292-005-3541-7 · Cited by 850 · see citing works
Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies.
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832 · see citing works
Motivación de los empleados: un poderoso modelo nuevo
Nohria, N., Groysberg, B., & Lee, L. (2008) · Harvard business review · Cited by 782 · see citing works
A Clinical Psychotherapy Trial for Adolescent Depression Comparing Cognitive, Family, and Supportive Therapy
Brent, D. A. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830210125017 · Cited by 753 · cited 1× · see citing works
“These included (1) psychotherapy (eg, cognitive behavioral therapy [22], interpersonal therapy [23], problem-solving therapy [24], supportive therapy [25]), (2) psychoeducation [26], and (3) exercise/physical activity [27] which showed results on par with a pharmacological treatment.”
Background
Gamification
Deterding, S. (2012) · interactions · doi:10.1145/2212877.2212883 · Cited by 725 · see citing works
Statistical power analysis for the behavioral sciences
Sockloff, A. L. (1978) · Evaluation and Program Planning · doi:10.1016/0149-7189(78)90080-0 · Cited by 715 · see citing works
Behavioral Intervention Technologies: Evidence review and recommendations for future research in mental health
Mohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · see citing works
Receiving social support online: implications for health education
White, M. (2001) · Health Education Research · doi:10.1093/her/16.6.693 · Cited by 606 · see citing works
Computer-tailored health interventions delivered over the web: Review and analysis of key components
Lustria, M. L. A., Cortese, J., Noar, S. M., & Glueckauf, R. L. (2009) · Patient Education and Counseling · doi:10.1016/j.pec.2008.08.023 · Cited by 566 · see citing works
Using Internet and Mobile Phone Technology to Deliver an Automated Physical Activity Program: Randomized Controlled Trial
Hurling, R., Catt, M., De Boni, M., Fairley, B. W., Hurst, T., Murray, P., Richardson, A., & Sodhi, J. S. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e7 · Cited by 536 · see citing works
Internet and Computer-Based Cognitive Behavioral Therapy for Anxiety and Depression in Youth: A Meta-Analysis of Randomized Controlled Outcome Trials
Ebert, D. D., Zarski, A.-C., Christensen, H., Stikkelbroek, Y., Cuijpers, P., Berking, M., & Riper, H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119895 · Cited by 533 · see citing works
Internet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · cited 1× · see citing works
“[32] Adults (≥16 years) Mild to severe Deprexis 76 Switzerland Germany Berger [33] Adults without older adults (18-75 years) Mild to severe Help4Mood 28 Romania Spain Scotland UK Burton [34] Adults (≥16 years) Mild to moderate Depressions-hjälpen 80 Sweden Carlbring [35] Adults (≥16 years) Minimal…”
Background
Selecting Studies and Collecting Data
Higgins, J. P., & Deeks, J. J. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch7 · Cited by 467 · see citing works
Social support in diabetes: a systematic review of controlled intervention studies
van Dam, H. A., van der Horst, F. G., Knoops, L., Ryckman, R. M., Crebolder, H. F. J. M., & van den Borne, B. H. P. (2004) · Patient Education and Counseling · doi:10.1016/j.pec.2004.11.001 · Cited by 467 · see citing works
Which Intervention Characteristics are Related to More Exposure to Internet-Delivered Healthy Lifestyle Promotion Interventions? A Systematic Review
Brouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455 · see citing works
Problem-solving therapy for depression: A meta-analysis
Bell, A. C., & D'Zurilla, T. J. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.02.003 · Cited by 448 · see citing works
Periodic Prompts and Reminders in Health Promotion and Health Behavior Interventions: Systematic Review
Fry, J. P., & Neff, R. A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1138 · Cited by 447 · see citing works
The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia
Lorig, K. R., Ritter, P. L., Laurent, D. D., & Plant, K. (2008) · Arthritis Care & Research · doi:10.1002/art.23817 · Cited by 440 · see citing works
Internet Treatment for Depression: A Randomized Controlled Trial Comparing Clinician vs. Technician Assistance
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406 · see citing works
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389 · see citing works
Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial
Kessler, D., Lewis, G., Kaur, S., Wiles, N., King, M., Weich, S., Sharp, D. J., Araya, R., Hollinghurst, S., & Peters, T. J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61257-5 · Cited by 387 · see citing works
Internet-Based Treatment of Depression: A Randomized Controlled Trial Comparing Guided with Unguided Self-Help
Berger, T., Hämmerli, K., Gubser, N., Andersson, G., & Caspar, F. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.616531 · Cited by 383 · see citing works
Overcoming Depression on the Internet (ODIN) (2): A Randomized Trial of a Self-Help Depression Skills Program With Reminders
Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · cited 2× · see citing works
“Stemming from Oinas-Kikkonens concept of reminders, Whitton et al [11] found that reminders play a decisive role in the engagement of users in mental health interventions and are a cost-effective approach for engaging users [11-13].”
Background
Improving adherence and clinical outcomes in self-guided internet treatment for anxiety and depression: randomised controlled trial
Titov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., Spence, J., McEvoy, P. M., & Rapee, R. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062873 · Cited by 364 · see citing works
Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial
Meyer, B., Berger, T., Caspar, F., Beevers, C. G., Andersson, G., & Weiss, M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1151 · Cited by 363 · cited 1× · see citing works
“…Ly [48] Adults without older adults (18-75 years) Moderately severe to severe Deprexis 163 Germany Meyer [49] Adults (≥16 years) NR Deprexis 396 Germany Meyer [50] Adults (≥16 years) Mild to severe Mood Memos 1736 UK Australia Canada Ireland New Zealand USA Morgan [51] Adults without older adults”
Background
A systematic review of research findings on the efficacy of interpersonal therapy for depressive disorders
de Mello, M. F., de Jesus Mari, J., Bacaltchuk, J., Verdeli, H., & Neugebauer, R. (2005) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-004-0542-x · Cited by 346 · cited 1× · see citing works
“These included (1) psychotherapy (eg, cognitive behavioral therapy [22], interpersonal therapy [23], problem-solving therapy [24], supportive therapy [25]), (2) psychoeducation [26], and (3) exercise/physical activity [27] which showed results on par with a pharmacological treatment.”
Background
Mobile Sensing and Support for People With Depression: A Pilot Trial in the Wild
Wahle, F., Kowatsch, T., Fleisch, E., Rufer, M., & Weidt, S. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5960 · Cited by 333 · see citing works
Self-citation
Internet-Delivered Psychological Treatments for Mood and Anxiety Disorders: A Systematic Review of Their Efficacy, Safety, and Cost-Effectiveness
Arnberg, F. K., Linton, S. J., Hultcrantz, M., Heintz, E., & Jonsson, U. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098118 · Cited by 330 · see citing works
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · see citing works
Embodying self-compassion within virtual reality and its effects on patients with depression
Falconer, C. J., Rovira, A., King, J. A., Gilbert, P., Antley, A., Fearon, P., Ralph, N., Slater, M., & Brewin, C. R. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.002147 · Cited by 312 · see citing works
Internet-based versus face-to-face cognitive-behavioral intervention for depression: A randomized controlled non-inferiority trial
Wagner, B., Horn, A. B., & Maercker, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.032 · Cited by 311 · see citing works
Web 2.0 for Health Promotion: Reviewing the Current Evidence
Chou, W.-Y. S., Prestin, A., Lyons, C., & Wen, K.-Y. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301071 · Cited by 309 · see citing works
Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial
SPEK, V., NYKLÍČEK, I., SMITS, N., CUIJPERS, P., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291707000542 · Cited by 307 · see citing works
What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis.
Morrison, L. G., Yardley, L., Powell, J., & Michie, S. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0062 · Cited by 290 · see citing works
Clinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290 · cited 3× · see citing works
“Adults (≥16 years) Mild to severe Sadness 48 Australia Perini [53]”
BackgroundMethodInfluential
Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review
Ali, K., Farrer, L. M., Gulliver, A., & Griffiths, K. M. (2015) · JMIR Mental Health · doi:10.2196/mental.4418 · Cited by 289 · see citing works
Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L., Craske, M. G., & McEvoy, P. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.007 · Cited by 285 · cited 1× · see citing works
“…material to download/print, (7) homework assignments, (8) mood rating / symptom tracking, (9) online diary/journal, (10) audio/voiceovers, (11) illustrative content, (12) games/quizzes, and (13) animations (virtual agent). a [76] a Rating system is 1=component present and 0=component not present.”
Background
Promoting motivation with virtual agents and avatars: role of visual presence and appearance
Baylor, A. L. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0148 · Cited by 275 · see citing works
The Influence of Online Comments on Perceptions of Antimarijuana Public Service Announcements on YouTube
Walther, J. B., DeAndrea, D. C., Kim, J.-S., & Anthony, J. C. (2010) · Human Communication Research · doi:10.1111/j.1468-2958.2010.01384.x · Cited by 270 · see citing works
Computer-based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: a randomized controlled trial of clinical efficacy
Kay‐Lambkin, F. J., Baker, A. L., Lewin, T. J., & Carr, V. J. (2009) · Addiction · doi:10.1111/j.1360-0443.2008.02444.x · Cited by 269 · cited 1× · see citing works
“…[41] Adults (≥ 16 years) Mild to severe No name 121 Sweden Johansson [42] Adults (≥ 16 years) Mild to severe SHADE 97 Australia Kay-Lambkin [43] Adults without older adults (18-75 years) Mild to severe No name 297 UK Kessler [44] Adults (≥16 years) Mild to moderate Depressions-hjälpen 92…”
Background
Tailored vs. Standardized Internet-Based Cognitive Behavior Therapy for Depression and Comorbid Symptoms: A Randomized Controlled Trial
Johansson, R., Sjöberg, E., Sjögren, M., Johnsson, E., Carlbring, P., Andersson, T., Rousseau, A., & Andersson, G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036905 · Cited by 268 · see citing works
A Comparison of Changes in Anxiety and Depression Symptoms of Spontaneous Users and Trial Participants of a Cognitive Behavior Therapy Website
Christensen, H., Griffiths, K. M., Korten, A. E., Brittliffe, K., & Groves, C. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e46 · Cited by 240 · cited 1× · see citing works
“The potential presence of publication bias likely had a significant impact on the results of this study, not only with respect to differences in usage of online interventions in clinical settings, but also in more real-world settings [84].”
Result
Internet administered guided self-help versus individualized e-mail therapy: A randomized trial of two versions of CBT for major depression
Vernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226 · see citing works
Disorder-specific versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: A randomized controlled trial
Titov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223 · see citing works
Game reward systems: Gaming experiences and social meanings
Wang, H., & Sun, C. (2011) · doi:10.26503/dl.v2011i1.594 · Cited by 214 · see citing works
Deconstructing current comorbidity: data from the Australian National Survey of Mental Health and Well-Being
Andrews, G., Slade, T. N., & Issakidis, C. (2002) · The British Journal of Psychiatry · doi:10.1192/bjp.181.4.306 · Cited by 212 · see citing works
Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial
Titov, N., Dear, B. F., Ali, S., Zou, J. B., Lorian, C. N., Johnston, L., Terides, M. D., Kayrouz, R., Klein, B., Gandy, M., et al. (2015) · Behavior Therapy · doi:10.1016/j.beth.2014.09.008 · Cited by 210 · see citing works
Review of randomised controlled trials of Internet interventions for mental disorders and related conditions
Griffiths, K. M., & Christensen, H. (2006) · Clinical Psychologist · doi:10.1080/13284200500378696 · Cited by 210 · see citing works
Clinical Advances in Cognitive Psychotherapy: Theory and Application
Leahy, R. L., & Dowd, E. T. (2002) · Cited by 205 · see citing works
Untitled work
(2008) · PubMed · Cited by 200 · see citing works
The design of motivational agents and avatars
Baylor, A. L. (2011) · Educational Technology Research and Development · doi:10.1007/s11423-011-9196-3 · Cited by 199 · see citing works
Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression
Doherty, G., Coyle, D., & Sharry, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208602 · Cited by 198 · cited 4× · see citing works
“In addition, more detailed information on their practices and how to deal with clients who are not engaging with the program should be provided [130].”
BackgroundInfluential
Rates and Determinants of Repeated Participation in a Web-Based Behavior Change Program for Healthy Body Weight and Healthy Lifestyle
Verheijden, M. W., Jans, M. P., Hildebrandt, V. H., & Hopman-Rock, M. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.1.e1 · Cited by 195 · see citing works
Randomised controlled non-inferiority trial with 3-year follow-up of internet-delivered versus face-to-face group cognitive behavioural therapy for depression
Andersson, G., Hesser, H., Veilord, A., Svedling, L., Andersson, F., Sleman, O., Mauritzson, L., Sarkohi, A., Claesson, E., Zetterqvist, V., et al. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.08.022 · Cited by 195 · see citing works
Effectiveness of an online computer-tailored physical activity intervention in a real-life setting
Spittaels, H., De Bourdeaudhuij, I., Brug, J., & Vandelanotte, C. (2006) · Health Education Research · doi:10.1093/her/cyl096 · Cited by 192 · see citing works
Clinical effectiveness of online computerised cognitive–behavioural therapy without support for depression in primary care: randomised trial
de Graaf, L. E., Gerhards, S. A. H., Arntz, A., Riper, H., Metsemakers, J. F. M., Evers, S. M. A. A., Severens, J. L., Widdershoven, G., & Huibers, M. J. H. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054429 · Cited by 190 · see citing works
Effects of an Internet intervention (Deprexis) on severe depression symptoms: Randomized controlled trial
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188 · see citing works
Standardized web-based cognitive behavioural therapy of mild to moderate depression: A randomized controlled trial with a long-term follow-up
Ruwaard, J., Schrieken, B., Schrijver, M., Broeksteeg, J., Dekker, J., Vermeulen, H., & Lange, A. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802408086 · Cited by 183 · cited 3× · see citing works
“50) 36 WLC Guided Web-based CBT Ruwaard [58]”
BackgroundMethodInfluential
Internet cognitive behavioural therapy for mixed anxiety and depression: a randomized controlled trial and evidence of effectiveness in primary care
Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013) · Psychological Medicine · doi:10.1017/s0033291713000111 · Cited by 181 · see citing works
Culturally attuned Internet treatment for depression amongst Chinese Australians: A randomised controlled trial
Choi, I., Zou, J., Titov, N., Dear, B. F., Li, S., Johnston, L., Andrews, G., & Hunt, C. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.11.003 · Cited by 180 · cited 1× · see citing works
“…moderate Depressions-hjälpen 80 Sweden Carlbring [35] Adults (≥16 years) Minimal to moderately severe Brighten Your Mood Program 63 Australia Choi [36] Adolescents (14-24 years) NR No name 160 USA Clarke [37] Adults without older adults (18-75 years) Mild to moderate Colour Your Life 303…”
Background
Does psychotherapy homework lead to improvements in depression in cognitive-behavioral therapy or does improvement lead to increased homework compliance?
Burns, D. D., & Spangler, D. L. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.1.46 · Cited by 180 · see citing works
Design and evaluation guidelines for mental health technologies
Doherty, G., Coyle, D., & Matthews, M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.006 · Cited by 179 · see citing works
Internet-based behavioral activation and acceptance-based treatment for depression: A randomized controlled trial
Carlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177 · see citing works
Smartphone-Supported versus Full Behavioural Activation for Depression: A Randomised Controlled Trial
Ly, K. H., Topooco, N., Cederlund, H., Wallin, A., Bergström, J., Molander, O., Carlbring, P., & Andersson, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126559 · Cited by 171 · see citing works
Does psychotherapy homework lead to improvements in depression in cognitive–behavioral therapy or does improvement lead to increased homework compliance?
Burns, D. D., & Spangler, D. L. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.1.46 · Cited by 171 · see citing works
Supportive text messaging for depression and comorbid alcohol use disorder: single-blind randomised trial
Agyapong, V. I. O., Ahern, S., McLoughlin, D. M., & Farren, C. K. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.02.040 · Cited by 167 · see citing works
Psychodynamic Guided Self-Help for Adult Depression through the Internet: A Randomised Controlled Trial
Johansson, R., Ekbladh, S., Hebert, A., Lindström, M., Möller, S., Petitt, E., Poysti, S., Larsson, M. H., Rousseau, A., Carlbring, P., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038021 · Cited by 167 · see citing works
Randomized Controlled Trial of an Internet-Based Versus Face-to-Face Dyspnea Self-Management Program for Patients With Chronic Obstructive Pulmonary Disease: Pilot Study
Nguyen, H. Q., Donesky, D., Wolpin, S. E., Reinke, L. F., Benditt, J. O., Paul, S. M., & Carrieri‐Kohlman, V. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.990 · Cited by 159 · see citing works
Randomized Effectiveness Trial of an Internet, Pure Self-Help, Cognitive Behavioral Intervention for Depressive Symptoms in Young Adults
Clarke, G., Kelleher, C., Hornbrook, M., DeBar, L., Dickerson, J., & Gullion, C. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802675353 · Cited by 154 · see citing works
The Clinical Effectiveness of Web-Based Cognitive Behavioral Therapy With Face-to-Face Therapist Support for Depressed Primary Care Patients: Randomized Controlled Trial
Høifødt, R. S., Lillevoll, K. R., Griffiths, K. M., Wilsgaard, T., Eisemann, M., Waterloo, K., & Kolstrup, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2714 · Cited by 154 · cited 2× · see citing works
“Only a small number of included studies made use of self-monitoring components, such as symptom tracking and tracking reminders, yet they are seen as key features of psychotherapy in particular [40,96], and in behavior-change interventions in general [12,115-118].”
Background
Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public
Brouwer, W., Oenema, A., Raat, H., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2010) · Health Education Research · doi:10.1093/her/cyp063 · Cited by 147 · cited 1× · see citing works
“From a system component perspective, there is a strong need to counteract the decrease of program usage over the course of the intervention that is typically found in unguided technology-mediated interventions for mental health [118,141,142].”
Background
Self-regulatory processes mediate the intention-behavior relation for adherence and exercise behaviors.
de Bruin, M., Sheeran, P., Kok, G., Hiemstra, A., Prins, J. M., Hospers, H. J., & van Breukelen, G. (2012) · Health Psychology · doi:10.1037/a0027425 · Cited by 143 · see citing works
A randomized controlled trial of internet-based therapy in depression
Moritz, S., Schilling, L., Hauschildt, M., Schröder, J., & Treszl, A. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.006 · Cited by 140 · see citing works
ACT Internet-based vs face-to-face? A randomized controlled trial of two ways to deliver Acceptance and Commitment Therapy for depressive symptoms: An 18-month follow-up
Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.006 · Cited by 138 · see citing works
Systematic Review on Internet Support Groups (ISGs) and Depression (2): What Is Known About Depression ISGs?
Griffiths, K. M., Calear, A. L., Banfield, M., & Tam, A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1303 · Cited by 136 · see citing works
Online interventions for depression and anxiety – a systematic review
Saddichha, S., Al-Desouki, M., Lamia, A., Linden, I. A., & Krausz, M. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.945934 · Cited by 133 · cited 2× · see citing works
“This extends the systematic review by Saddichha et al [8], which consisted of 29 RCT studies using CBT.”
BackgroundMethod
A psychoeducational approach to the treatment of depression: A meta-analysis of lewinsohn's “coping with depression” course
Cuijpers, P. J. (1998) · Behavior Therapy · doi:10.1016/s0005-7894(98)80047-6 · Cited by 129 · see citing works
Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression
Burton, C., Szentagotai Tatar, A., McKinstry, B., Matheson, C., Matu, S., Moldovan, R., Macnab, M., Farrow, E., David, D., Pagliari, C., et al. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15609793 · Cited by 125 · see citing works
Web-Based Acceptance and Commitment Therapy for Depressive Symptoms With Minimal Support: A Randomized Controlled Trial
Lappalainen, P., Langrial, S., Oinas-Kukkonen, H., Tolvanen, A., & Lappalainen, R. (2015) · Behavior Modification · doi:10.1177/0145445515598142 · Cited by 115 · see citing works
Patient Health Questionnaire Depression Scale as a Suicide Screening Instrument in Depressed Primary Care Patients
Uebelacker, L. A., German, N. M., Gaudiano, B. A., & Miller, I. W. (2011) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.10m01027 · Cited by 114 · see citing works
Randomized trial of Internet-based relapse prevention for partially remitted depression: Preventing relapse in MDD via the Internet
Holländare, F., Johnsson, S., Randestad, M., Tillfors, M., Carlbring, P., Andersson, G., & Engström, I. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01698.x · Cited by 111 · see citing works
Randomized controlled trial of computerized cognitive behavioural therapy for depressive symptoms: effectiveness and costs of a workplace intervention
Phillips, R., Schneider, J., Molosankwe, I., Leese, M., Foroushani, P. S., Grime, P., McCrone, P., Morriss, R., & Thornicroft, G. (2014) · Psychological Medicine · doi:10.1017/s0033291713001323 · Cited by 110 · cited 3× · see citing works
“0 0 1 0 0 0 1 0 0 0 0 0 1 Feedback/reminders Online Phillips [54]”
BackgroundInfluential
A randomized controlled trial of an internet-delivered treatment: Its potential as a low-intensity community intervention for adults with symptoms of depression
Richards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109 · see citing works
Homework Compliance Counts in Cognitive-Behavioral Therapy
LeBeau, R. T., Davies, C. D., Culver, N. C., & Craske, M. G. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.763286 · Cited by 105 · cited 1× · see citing works
“In a recent study, LeBeau et al [103] concluded that “improvement of homework compliance has the potential to be a highly practical and effective way to improve clinical outcomes in CBT.” Therefore, implemented in an appealing interactive way, this might represent an important component in MHIS.”
Background
Affect-focused psychodynamic psychotherapy for depression and anxiety through the Internet: a randomized controlled trial
Johansson, R., Björklund, M., Hornborg, C., Karlsson, S., Hesser, H., Ljótsson, B., Rousseau, A., Frederick, R. J., & Andersson, G. (2013) · PeerJ · doi:10.7717/peerj.102 · Cited by 102 · see citing works
Internet-Based Therapy for Mild to Moderate Depression in Swedish Primary Care: Short Term Results from the PRIM-NET Randomized Controlled Trial
Kivi, M., Eriksson, M. C. M., Hange, D., Petersson, E.-L., Vernmark, K., Johansson, B., & Björkelund, C. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2014.921834 · Cited by 92 · cited 1× · see citing works
“…older adults (18-75 years) Mild to severe No name 297 UK Kessler [44] Adults (≥16 years) Mild to moderate Depressions-hjälpen 92 Sweden Kivi [45] Adults (≥16 years) Mild to severe Good Life Compass 39 Finland Lappalainen [46] Adults (≥16 years) Mild to severe Good Life Compass 38 Finland…”
Background
The development and beta-test of a computer-therapy program for anxiety and depression: hurdles and lessons
Proudfoot, J., Swain, S., Widmer, S., Watkins, E., Goldberg, D., Marks, I., Mann, A., & Gray, J. A. (2003) · Computers in Human Behavior · doi:10.1016/s0747-5632(02)00062-6 · Cited by 91 · see citing works
The Role of User Control in Adherence to and Knowledge Gained from a Website: Randomized Comparison Between a Tunneled Version and a Freedom-of-Choice Version
Crutzen, R., Cyr, D., & de Vries, N. K. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1922 · Cited by 91 · see citing works
Which Combinations of Techniques and Modes of Delivery in Internet-Based Interventions Effectively Change Health Behavior? A Meta-Analysis
van Genugten, L., Dusseldorp, E., Webb, T. L., & van Empelen, P. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4218 · Cited by 88 · see citing works
Life-review therapy with computer supplements for depression in the elderly: A randomized controlled trial
Preschl, B., Maercker, A., Wagner, B., Forstmeier, S., Baños, R. M., Alcañiz, M., Castilla, D., & Botella, C. (2012) · Aging & Mental Health · doi:10.1080/13607863.2012.702726 · Cited by 86 · see citing works
Randomized trial of a neighborhood environment-focused physical activity website intervention
Ferney, S. L., Marshall, A. L., Eakin, E. G., & Owen, N. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2008.10.022 · Cited by 85 · see citing works
Development and pilot evaluation of an Internet-facilitated cognitive-behavioral intervention for maternal depression.
Sheeber, L. B., Seeley, J. R., Feil, E. G., Davis, B., Sorensen, E., Kosty, D. B., & Lewinsohn, P. M. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028820 · Cited by 81 · see citing works
ChewFree.com: Evaluation of a Web-based cessation program for smokeless tobacco users
Severson, H., Gordon, J., Danaher, B., & Akers, L. (2008) · Nicotine & Tobacco Research · doi:10.1080/14622200701824984 · Cited by 81 · see citing works
Screen vs. paper: what is the difference for reading and learning?
Myrberg, C., & Wiberg, N. (2015) · Insights the UKSG journal · doi:10.1629/uksg.236 · Cited by 76 · see citing works
Breaking open the black box: isolating the most potent features of a web and mobile phone-based intervention for depression, anxiety, and stress
Whitton, A. E., Proudfoot, J., Clarke, J., Birch, M.-R., Parker, G., Manicavasagar, V., & Hadzi-Pavlovic, D. (2015) · JMIR Mental Health · doi:10.2196/mental.3573 · Cited by 69 · see citing works
Building a Social Conversational Pedagogical Agent
Gulz, A., Haake, M., Silvervarg, A., Sjödén, B., & Veletsianos, G. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-617-6.ch006 · Cited by 67 · see citing works
Text message reminders to improve outpatient therapy attendance among adolescents: A pilot study.
Branson, C. E., Clemmey, P. A., & Mukherjee, P. P. (2011) · Psychological Services · doi:10.1037/a0026693 · Cited by 66 · see citing works
Internet-delivered therapist-guided physical activity for mild to moderate depression: a randomized controlled trial
Ström, M., Uckelstam, C.-J., Andersson, G., Hassmén, P., Umefjord, G., & Carlbring, P. (2013) · PeerJ · doi:10.7717/peerj.178 · Cited by 64 · see citing works
A conceptual framework for understanding and improving adolescents' exposure to Internet-delivered interventions
Crutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2009) · Health Promotion International · doi:10.1093/heapro/dap018 · Cited by 60 · see citing works
The UniWellbeing course: A randomised controlled trial of a transdiagnostic internet-delivered cognitive behavioural therapy (CBT) programme for university students with symptoms of anxiety and depression
Mullin, A., Dear, B. F., Karin, E., Wootton, B. M., Staples, L., Johnston, L., Gandy, M., Fogliati, V. J., & Titov, N. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.02.002 · Cited by 58 · see citing works
A comparison of two online cognitive‐behavioural interventions for symptoms of depression in a student population: The role of therapist responsiveness
Richards, D., Timulak, L., & Hevey, D. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2012.733715 · Cited by 55 · see citing works
Process Evaluation of an Internet-based Resource for Weight Control: Use and Views of an Obese Sample
McConnon, Á., Kirk, S., & Ransley, J. K. (2009) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2008.07.008 · Cited by 44 · see citing works
A comparison of two online cognitive-behavioural interventions for symptoms of depression in a student population: the role of therapist responsiveness
Timulák, L. (2012) · doi:10.1186/isrctn63094649 · Cited by 37 · see citing works
Self-reflection in cognitive behavioural therapy and supervision
Praško, J. P., Mozny, P., Novotný, M., Šlepecký, M., & Vyskocilova, J. (2012) · Biomedical Papers · doi:10.5507/bp.2012.027 · Cited by 33 · see citing works
Frequency and Type of Use of a Home-Based, Internet Intervention for Adolescent Smoking Cessation
Patten, C. A., Rock, E., Meis, T. M., Decker, P. A., Colligan, R. C., Pingree, S., Dornelas, E. A., Offord, K. P., Boberg, E. W., & Gustafson, D. H. (2007) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2007.05.016 · Cited by 32 · see citing works
Self-Help for Depression via E-mail: A Randomised Controlled Trial of Effects on Depression and Self-Help Behaviour
Morgan, A. J., Jorm, A. F., & Mackinnon, A. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066537 · Cited by 15 · see citing works
Statistical methods in cancer research.
Watson, F. R. (1967) · PubMed · Cited by 10 · see citing works
Tailoring Health Messages: Customizing Communication with Computer Technology. Edited by Matthew Kreuter, David Farrell, Laura Olevitch and Laura Brennan. Lawrence Erlbaum Assoc, 1999. 270pp, ISBN: 0805833870
Jones, R. B., Bental, D. S., Cawsey, A. J., Pearson, J., & Marsden, J. (2002) · Psycho-Oncology · doi:10.1002/pon.609 · Cited by 9 · see citing works
Can Assessors in a Psychotherapy Trial Be Successfully Blinded? Analysis of a Randomized Controlled Trial on Psychotherapy for Refractory Insomnia in Residual Depression
Watanabe, N., Furukawa, T. A., Shimodera, S., Katsuki, F., Fujita, H., Sasaki, M., Suga, Y., Kakeda, K., & Perlis, M. L. (2013) · Psychotherapy and Psychosomatics · doi:10.1159/000353174 · Cited by 5 · see citing works
Technology-adaptable interventions for treating depression in adults with cognitive impairments: protocol for a systematic review
Topolovec‐Vranic, J., Mansoor, Y., Ennis, N., & Lightfoot, D. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0032-4 · Cited by 3 · see citing works

Flagged first, then by citations

Research works printed but not linked: 5

[16]Wahle F Kowatsch T Towards the design of evidence-based mental health information systems: a preliminary literature review Proceedings of the Thirty Fifth International Conference on Information Systems, Auckland 2014 2014 Thirty Fifth International Conference on Information Systems Dec 14-17, 2014 Auckland, New Zealand 12 14
[68]Effective Practice and Organisation of Care Synthesising results when it does not make sense to do a meta-analysis. EPOC Resources for review authors 2013 Oslo Norwegian Knowledge Centre for the Health Services http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/20
[77]Cochrane Community 2017-01-22 About RevMan 5 http://community.cochrane.org/tools/review-production-tools/revman-5/about
[79]Balk E Earley A Patel K Trikalinos T Dahabreh I Empirical Assessment of Within-Arm Correlation Imputation in Trials of Continuous Outcomes [Internet]. Report No.: 12(13)-EHC141-EF 2012 Rockville, MD Agency for Healthcare Research and Quality 23326900
[111]Oinas-Kukkonen H Harjumaa M A systematic framework for designing and evaluating persuasive systems Persuasive Technology. PERSUASIVE 2008. Lecture Notes in Computer Science, vol 5033 2008 Berlin Springer 164 169

Sorted by citations

Internet Interventions for Adults with Anxiety and Mood Disorders: A Narrative Umbrella Review of Recent Meta-Analyses
Andersson, G., Carlbring, P., Titov, N., & Lindefors, N. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719839381 · Cited by 324 · see citing works
Smartphone Cognitive Behavioral Therapy as an Adjunct to Pharmacotherapy for Refractory Depression: Randomized Controlled Trial
Mantani, A., Kato, T., Furukawa, T. A., Horikoshi, M., Imai, H., Hiroe, T., Chino, B., Funayama, T., Yonemoto, N., Zhou, Q., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8602 · Cited by 192 · see citing works
The therapeutic effectiveness of artificial intelligence-based chatbots in alleviation of depressive and anxiety symptoms in short-course treatments: A systematic review and meta-analysis
Zhong, W., Luo, J., & Zhang, H. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.04.057 · Cited by 204 · see citing works
Chatbot-Delivered Psychotherapy for Adults With Depressive and Anxiety Symptoms: A Systematic Review and Meta-Regression
Lim, S. M., Shiau, C. W. C., Cheng, L. J., & Lau, Y. (2022) · Behavior Therapy · doi:10.1016/j.beth.2021.09.007 · Cited by 163 · see citing works
Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students
Xu, X., Chikersal, P., Doryab, A., Villalba, D. K., Dutcher, J. M., Tumminia, M. J., Althoff, T., Cohen, S., Creswell, K. G., Creswell, J. D., et al. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351274 · Cited by 125 · see citing works
Employees’ Perspectives on the Facilitators and Barriers to Engaging With Digital Mental Health Interventions in the Workplace: Qualitative Study
Carolan, S., & de Visser, R. O. (2018) · JMIR Mental Health · doi:10.2196/mental.9146 · Cited by 121 · see citing works
“There is also evidence, however, that these email prompts could be easily ignored (and even resented) in a workplace context as a consequence of a full inbox [49].”
Current state of scientific evidence on internet-based interventions for the treatment of depression, anxiety, eating disorders and substance abuse: an overview of systematic reviews and meta-analyses
Taylor, C. B., Graham, A. K., Flatt, R. E., Waldherr, K., & Fitzsimmons-Craft, E. E. (2021) · European Journal of Public Health · doi:10.1093/eurpub/ckz208 · Cited by 114 · see citing works
Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I. (2021) · JMIR Mental Health · doi:10.2196/32199 · Cited by 95 · see citing works
“However, heterogeneity was nearly identical to past research on this topic, and we took statistical efforts to minimize this impact [38].”
BackgroundResultInfluential
Methods for Human-Centered eHealth Development: Narrative Scoping Review
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2022) · Journal of Medical Internet Research · doi:10.2196/31858 · Cited by 67 · see citing works
Acceptance and Expectations of Medical Experts, Students, and Patients Toward Electronic Mental Health Apps: Cross-Sectional Quantitative and Qualitative Survey Study
Mayer, G., Gronewold, N., Alvarez, S., Bruns, B., Hilbel, T., & Schultz, J. (2019) · JMIR Mental Health · doi:10.2196/14018 · Cited by 72 · see citing works
Suicide Risk in Emerging Adulthood: Associations with Screen Time over 10 years
Coyne, S. M., Hurst, J. L., Dyer, W. J., Hunt, Q. A., Schvanaveldt, E., Brown, S., & Jones, G. C. (2021) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01389-6 · Cited by 72 · see citing works
Methods for Human-Centered eHealth Development: Narrative Scoping Review (Preprint)
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2021) · doi:10.2196/preprints.31858 · Cited by 67 · see citing works
Patient and physician perspectives of a smartphone application for depression: a qualitative study
Patoz, M.-C., Hidalgo‐Mazzei, D., Blanc, O., Verdolini, N., Pacchiarotti, I., Murru, A., Zukerwar, L., Vieta, E., Llorca, P., & Samalin, L. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03064-x · Cited by 36 · see citing works
The Effectiveness of Electronic Health Interventions for Promoting HIV-Preventive Behaviors Among Men Who Have Sex With Men: Meta-Analysis Based on an Integrative Framework of Design and Implementation Features
Xin, M., Viswanath, K., Li, A. Y. C., Cao, W., Yuhong, H., Lau, J. T. F., & Mo, P. K. H. (2020) · Journal of Medical Internet Research · doi:10.2196/15977 · Cited by 36 · see citing works
Assessing the effectiveness of internet‐based interventions for mental health outcomes: an umbrella review
Zhang, M., Fan, C. G., Ma, L., Wang, H., Zu, Z., Lin-xi, Y., Chen, F., Wei, W., & Li, X. (2024) · General Psychiatry · doi:10.1136/gpsych-2023-101355 · Cited by 37 · see citing works
Interventions in Chinese Undergraduate Students’ Mental Health: Systematic Review
Shan, Y., Ji, M., Xie, W., Li, R., Qian, X., Zhang, X., & Hao, T. (2022) · Interactive Journal of Medical Research · doi:10.2196/38249 · Cited by 41 · see citing works
Understanding Privacy Risks and Perceived Benefits in Open Dataset Collection for Mobile Affective Computing
Lee, H., Kang, S., & Lee, U. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534623 · Cited by 25 · see citing works
Efficacy of mobile context-aware notification management systems: A systematic literature review and meta-analysis
Künzler, F., Kramer, J.-N., & Kowatsch, T. (2017) · IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) · doi:10.1109/wimob.2017.8115839 · Cited by 21 · see citing works
Self-citation
Use of Mobile Sensing Data for Longitudinal Monitoring and Prediction of Depression Severity: Systematic Review
Amin, R., Schreynemackers, S., Oppenheimer, H., Petrovic, M., Hegerl, U., & Reich, H. (2025) · Journal of Medical Internet Research · doi:10.2196/57418 · Cited by 24 · see citing works
Exploring User Needs for a Mobile Behavioral-Sensing Technology for Depression Management: Qualitative Study
Meng, J., Hussain, S. A., Mohr, D. C., Czerwinski, M. P., & Zhang, M. (2018) · Journal of Medical Internet Research · doi:10.2196/10139 · Cited by 19 · see citing works
Perceived Effectiveness and Motivations for the Use of Web-Based Mental Health Programs: Qualitative Study
Eccles, H., Nannarone, M., Lashewicz, B., Attridge, M. D., Marchand, A., Aiken, A. B., Ho, K., & Wang, J. (2020) · Journal of Medical Internet Research · doi:10.2196/16961 · Cited by 17 · see citing works
Efficacy of mobile context-aware notification management systems: A systematic literature review and meta-analysis
Künzler, F., Kramer, J.-N., & Kowatsch, T. (2017) · Alexandria (UniSG) (University of St.Gallen) · doi:10.3929/ethz-b-000218431 · Cited by 14 · see citing works
Self-citation
Potential Reduction of Symptoms With the Use of Persuasive Systems Design Features in Internet-Based Cognitive Behavioral Therapy Programs for Children and Adolescents With Anxiety: A Realist Synthesis
Radomski, A. D., Wozney, L., McGrath, P. J., Huguet, A., Hartling, L., Dyson, M. P., BENNETT, K. J., & Newton, A. S. (2019) · JMIR Mental Health · doi:10.2196/13807 · Cited by 12 · see citing works
Digital technology and mental health during the COVID-19 pandemic: a narrative review with a focus on depression, anxiety, stress, and trauma
Guest, P. C., Vasilevska, V., Al-Hamadi, A. K., Eder, J., Falkai, P., & Steiner, J. H. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1227426 · Cited by 15 · see citing works
A Digital Tool to Build the Capacity of Leaders to Improve Working Conditions Related to Psychological Health and Well-Being in Teams: Intervention Approach, Prototype, and Evaluation Design of the Web-Application “wecoach”
Grimm, L. A., Bauer, G. F., & Jenny, G. J. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.521355 · Cited by 8 · see citing works
Construction of Rural Left-Behind Children’s Mental Health Mobile Information System Based on the Internet of Things
Liu, X. (2021) · Mobile Information Systems · doi:10.1155/2021/5490243 · Cited by 7 · see citing works
Coaching im digitalen Wandel
Digitalisierung und Design" 2018 Olten Internationaler Coachingkongress "Organisation, Wegener, R., Ackermann, S., Amstutz, J., Deplazes, S., Künzli, H., Ryter, A., & Ruprecht, V. &. (2020) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666407420 · Cited by 7 · see citing works
I Need to Know: Using the CeHRes Roadmap to Develop a Treatment Feedback Tool for Youngsters with Mental Health Problems
Bongers, I. L., Buitenweg, D. C., van Kuijk, R. E. F. M., & van Nieuwenhuizen, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191710834 · Cited by 7 · see citing works
Developing an Online Intervention to Equip Tertiary Piano Students With Skills and Strategies for Effective Practice
Suzuki, A., Ginsborg, J., Phillips, M., & Franklin, Z. C. (2024) · Music & Science · doi:10.1177/20592043241262612 · Cited by 5 · see citing works
The Case for Cognitive-Affective Architectures as Affective User Models in Behavioral Health Technologies
Hudlická, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50439-7_13 · Cited by 5 · see citing works
Mental health mobile app use to manage psychological difficulties: an umbrella review
Badesha, K., Wilde, S., & Dawson, D. L. (2022) · Mental Health Review Journal · doi:10.1108/mhrj-02-2021-0014 · Cited by 6 · see citing works
Retracted: Application of an Isolated Word Speech Recognition System in the Field of Mental Health Consultation: Development and Usability Study
Fu, W. (2020) · JMIR Medical Informatics · doi:10.2196/18677 · Cited by 4 · see citing works
Retracted
AI Mental Health Therapist Chatbot
Joshi, K. V. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.56393 · Cited by 4 · see citing works
Kompetenzentwicklung für Online-Coaching
Deplazes, S., & Künzli, H. (2020) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666407420.30 · Cited by 4 · see citing works
Key Issues in the Development of an Evidence-Based Stratified Surgical Patient Safety Improvement Information System: Experience From a Multicenter Surgical Safety Program
Yu, X., Han, W., Jiang, J., Wang, Y., Xin, S., Wu, S., Sun, H. J., Wang, Z., & Zhao, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/13576 · Cited by 4 · see citing works
Analysis and Design of Web-Based Mobile Library Services from an Economic Perspective
Aminudin, Abinowi, E., Andini, K. N., Sri, R. D., & Dzulfiqor, H. A. (2024) · Jurnal Informatika Ekonomi Bisnis · doi:10.37034/infeb.v6i1.858 · Cited by 3 · see citing works
Brief digital mental health interventions for adults with emerging symptoms: part II. User experience outcomes based on a systematic review
Opie, J. E., Vuong, A. T., McIntosh, J., & Kuntsche, S. (2025) · Mental Health and Digital Technologies · doi:10.1108/mhdt-07-2025-0050 · Cited by 2 · see citing works
Terapia cognitiva con entrega virtual en trastorno depresivo persistente: estudio de caso
García, N. B. (2019) · Clínica Contemporánea · doi:10.5093/cc2019a21 · Cited by 3 · see citing works
The State of Health Information Systems Research in Africa: A Scoping Review
Watat, J. K., & Agbozo, E. (2022) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-17968-6_19 · Cited by 2 · see citing works
Design of Psycho-educational Web-Based Interventions for People with Mental Disorders: a Systematic Review
Esfahani, M. Z., Ahmadi, M., & Dehnad, A. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00141-y · Cited by 2 · see citing works
An mHealth Intervention to Improve Guardians’ Adherence to Children’s Follow-Up Care for Acute Lymphoblastic Leukemia in Tanzania (GuardiansCan Project): Protocol for a Development and Feasibility Study
Chiwanga, F. S., Woodford, J., Masika, G. M., Richards, D. A., Savi, V., & von Essén, L. (2023) · JMIR Research Protocols · doi:10.2196/48799 · Cited by 3 · see citing works
Conversational Agents in Healthcare: Where Are We Going?
von Wangenheim, F., & Ventouris, J. (2020) · Springer eBooks · doi:10.1007/978-3-658-28672-9_34 · Cited by 1 · see citing works
A redesigned training and staff support programme to enhance job retention in employees with moderate-severe depression
Walker, N., & Dobbing, R. (2021) · Mental Health and Social Inclusion · doi:10.1108/mhsi-12-2020-0089 · Cited by 1 · see citing works
Die digitale Pille für chronische Krankheiten
Kowatsch, T., FischerTaeschler, D., Putzing, F., Bürki, P., Stettler, C., Chiesa-Tanner, G., & Fleisch, E. (2019) · Springer eBooks · doi:10.1007/978-3-658-25461-2_12
Self-citation
Applications of Machine Learning in Mental Healthcare
Davcheva, E. (2021) · Technischen Universität Darmstadt · doi:10.26083/tuprints-00017879
Bibliography
(2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78756-675-020211019
Attitude and Perceptions of Technology Enabled Mental Health Care for Supporting Occupational Mental Health and Well Being Among Doctors in India
Bhatnagar, N., Swaroop, V., Mandal, I., & Singh, M. M. (2025) · Indian Journal of Occupational and Environmental Medicine · doi:10.4103/ijoem.ijoem_144_24
The effects of artificial intelligence-based chatbots on mental health: A systematic review and three-level meta-analysis
Wang, Q., Zhong, J., Qi, K., Bao, H., Wang, Y., Guo, S., & Chen, A. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117459
Using Simulations, Games, and Apps to Support the Mental Health of First Responders
Englert, D. R., Sachau, D. A., & Lassiter, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-27978-1_16

Mobile Mental Health Information System for People with Depression
Wahle, F. (2017) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000211797
Self-citation
Rationale and design of a systematic review: Effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management
Köhnen, M., Kriston, L., Härter, M., Dirmaier, J., & Liebherz, S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028042 · Cited by 10 · see citing works
Technological State of the Art of Electronic Mental Health Interventions for Major Depressive Disorder: Systematic Literature Review
Burger, F., Neerincx, M. A., & Brinkman, W. (2019) · Journal of Medical Internet Research · doi:10.2196/12599 · Cited by 45 · see citing works
The Effectiveness of Digital Technology Interventions for Depression and Anxiety symptoms: A Systematic Review and Meta-Analysis of Randomized Controlled Trials (Preprint)
Zhang, L., Zhan, Q., Zhang, H., & Li, X. (2026) · Journal of Medical Internet Research · doi:10.2196/93424
The Use of Technology in the Clinical Care of Depression
Apaydin, E. A., Ruelaz, A. R., Raaen, L. B., Motala, A., Baxi, S. M., Shanman, R., & Hempel, S. (2018) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.18r12118

Authors: Wahle, F., Bollhalder, L., Kowatsch, T., & Fleisch, E.
Affiliations: ETH Zurich (CH)
University of St.Gallen (CH)
Corresponding author: Kowatsch, Tobias
ORCID: Wahle, Fabian
Bollhalder, Lea
Kowatsch, Tobias
Fleisch, Elgar
Venue: Journal of Medical Internet Research
Publisher: JMIR Publications Inc.
Published: 2017-05-31
Volume: 19
Issue: 5
Pages: e191
ISSN: 1438-8871 (ISSN-L)
DOI: 10.2196/jmir.7381
PMC: PMC5471345
OpenAlex: W2618967963
Cited by: 48
References: 140
Citations by year: 2026: 2 · 2025: 3 · 2024: 4 · 2023: 3 · 2022: 5 · 2021: 9 · 2020: 10 · 2019: 7 · 2018: 2 · 2017: 3
FWCI: 0.70
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
Locations: Journal of Medical Internet Research (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
Alexandria (UniSG) (University of St.Gallen) (acceptedVersion)
Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
ETH Zürich Research Collection (cc-by)
Topics: Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords: depression, mental health information systems, technology-based interventions, online intervention, mobile phone intervention, treatment components, depressive symptom reduction
MeSH terms: Depression, Humans, Mental Health, Treatment Outcome, Health Information Systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Toward the Design of Evidence-Based Mental Health Information Systems for People With Depression: A Systematic Literature Review and Meta-Analysis

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks