The DOI matches its Crossref record; 74 of the 78 references it cites were found in a registry or an index; 5 of the 28 sources its claims cite were checked for support.
Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management
Open accessAbstract
Introduction Although many effective treatment options exist, depression is still undertreated indicating gaps in the healthcare system. The complementary provision of mental healthcare through technologies (eg, computer, smartphone) has the potential to fill treatment gaps and to overcome access barriers to mental healthcare. Until now, no systematic review integrates the evidence on different technology-based psychological interventions (TBIs) concerning their effectiveness and acceptance in different clinical phases of depression management (bridging waiting periods, acute treatment and aftercare). The aim of this project is to structure evidence on TBIs regarding different phases of depression management, and to determine effectiveness and acceptance for each clinical phase considering both active (eg, face-to-face treatment) and inactive (eg, waitlist) controls as comparators. Methods and analysis We will include studies on adults with a formal diagnosis of unipolar depression. Treatments delivered by technologies based on scientific psychological theories will be considered as experimental interventions. The primary effectiveness outcome will be depressive symptoms at study endpoint measured by symptom severity rating scales, and the primary acceptance outcome will be dropping out of the study due to any reason. We will consider only randomised controlled trials, which will be identified by key database searches (including Cochrane Central Register of Controlled Trials, Medline, PsycINFO, PSYNDEX, CINAHL) complemented through searches in clinical trial registries (eg, clinicaltrials.gov) and grey literature searches (eg, Open Grey). Two review authors will independently conduct study selection, data extraction and quality assessment of included studies (using the Cochrane Collaboration's tool for assessing risk of bias). Meta-analyses applying random-effect models as well as subgroup, meta-regression and sensitivity analyses will be performed. Ethics and dissemination Ethics approval is not required for this study, as we conduct research on secondary data. We will disseminate results via peer-reviewed journal publications, presentations on conferences and via plain language summaries. PROSPERO registration number CRD42016050413; Pre-results. © 2019 Author(s) (or their employer(s)). Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Overview
CoChat Summary
## TL;DR
This paper is a protocol for a systematic review that will synthesize randomized trial evidence on technology-based psychological interventions for depression across waiting periods, acute treatment, and aftercare. It will examine both effectiveness on depressive symptoms and acceptance/safety, with dropout due to any reason as the primary acceptance outcome.
## Key findings
- Not stated in the paper.
- The planned review will include only randomized controlled trials of adults with a formal diagnosis of unipolar depression; the protocol also allows participants under 18 only if the mean age is at least 18 years.
- The review will evaluate depressive symptom severity at the end of intervention as the primary effectiveness outcome, and dropout due to any reason as the primary acceptance outcome.
- The authors note that prior reviews found guided cCBT had larger effects than unguided cCBT (d = 0.61 vs d = 0.25), and another review found an overall effect size of d = 0.56 for computer-based interventions; they also note higher dropout in unsupported than supported interventions.
## Methods
- Protocol for a systematic review and meta-analysis, conducted according to Cochrane standards and reported per PRISMA; PROSPERO registration number CRD42016050413.
- Planned data sources: CENTRAL, Medline, PsycINFO, PSYNDEX, CINAHL, clinical trial registries, and grey literature sources; no restrictions by date, language, or publication status.
- Planned analyses: independent screening/data extraction/risk-of-bias assessment by two reviewers; random-effects meta-analyses, subgroup analyses, meta-regression, sensitivity analyses, and GRADE assessment of evidence quality.
## Limitations
- The paper states that the strict inclusion and exclusion criteria increase transparency and focus on high-quality research but exclude studies not meeting those criteria, such as quasi-randomized trials.
- The paper states that the review’s broad scope may lead to substantial heterogeneity, which can only be explained if sufficient evidence is available.
- Evident from the text: this is a protocol, so no review results are reported in the paper itself.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 15 Not checked · 13 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Access to mental health services for affected individuals is impeded by both structural (eg, lack of availability) and attitudinal (eg, fear of stigma) barriers.13”
§ Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management > Introduction
What the sources say
- Supportedcites [13] source
The Discussion reports structural barriers involving service availability and identifies stigma as a reason people do not receive treatment. The Conclusions also identify attitudinal and structural barriers to seeking and staying in treatment. Page numbers are not provided in our copy. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However broad economic evaluations in this research context are still scarce.24”
§ Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management > Introduction
What the sources say
- Supportedcites [24] Arnberg, 2014, Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness, PLoS One source
The Cost-effectiveness section reports that only five of 139 studies screened for cost-effectiveness data met the eligibility criteria, and only two of those had a moderate risk of bias. The Discussion also describes the data available for cost-effectiveness analyses as scant. No page number is available in our copy. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Additionally, it has been shown that computerised CBT (cCBT) is cost effective when compared with usual care,22 no treatment23 or conventional CBT.23”
§ Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management > Introduction
What the sources say
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“TBIs hold the opportunity to reach people who live in remote areas or those with disabilities and without easy access to healthcare services.15–17”
§ Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management > Introduction
What the sources say
- Not checked — no full text of the sourcecites [15] source
- Not checked — no full text of the sourcecites [16] source
- Not checked — no full text of the sourcecites [17] Carrard, 2006, Evaluation and deployment of evidence based patient self-management support program for Bulimia Nervosa, Int J Med Inform source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Furthermore, people who refuse to seek out traditional services, especially those who wish to remain anonymous, may use technology-based mental health services.18”
§ Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management > Introduction
What the sources say
- Not checked — no full text of the sourcecites [18] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
5 more claims
Create a free account to see all 32 claims and to verify the 2 references still open.
- It may state two separate claims as one. 9
- Probably not a substantial claim. 19
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 1×
“Assessment of heterogeneity We will investigate statistical heterogeneity in primary studies by using Cochran’s Q-test and will quantify it using the I2 statistic.(56) We will display our results visually as forest plots.”
MethodThe CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“data synthesis We will run meta-analyses by applying random effects models.(61) We assume that the primary studies will vary considerably regarding sample, treatment, and methodological characteristics.”
MethodAn inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Research works printed but not linked: 2
- DGPPN, BÄK, KBV, et al. Version 5 [S3-Guideline/National Disease Management Guidline Unipolar Depression – Long Version, 2nd edition. 2015. Version 5]. In: DGPPN, BÄK, KBV, et al. eds, S3-Leitlinie/Nationale VersorgungsLeitlinie Unipolare Depression - Langfassung, 2. Auflage. 2nd edition, 2015.
- World Health Organization, editor. The Global Burden of Disease: 2004 Update. Geneva: WHO Press, 2008.
Cited by
Wehmann, E., Köhnen, M., Härter, M. C., & Liebherz, S. (2020) · Journal of Medical Internet Research · doi:10.2196/17195 · Cited by 51
Self-citationEvidence on Technology-Based Psychological Interventions in Diagnosed Depression: Systematic Review
Köhnen, M., Dreier, M., Seeralan, T., Kriston, L., Härter, M., Baumeister, H., & Liebherz, S. (2021) · JMIR Mental Health · doi:10.2196/21700 · Cited by 23
“…being (at least partly) delivered by technical mediums and tailored to the treatment of depression (eg, guided or unguided web-based self-help programs, telephone therapy, or the combination of onsite therapy and web-based self-help; see study protocol by Köhnen et al [12] for details).”
InfluentialSelf-citationErasmus, P., Borrmann, M., Becker, J., Kuchinke, L., & Meinlschmidt, G. (2025) · Interactive Journal of Medical Research · doi:10.2196/46441 · Cited by 15
Soltani, Z., Parizad, N., Radfar, M., Alinejad, V., Arzanlo, M., & Haghighi, M. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-05688-1 · Cited by 9
“Therefore, any action used at home for patients can lead to tremendous success rather than hospital-based methods [1, 15, 16].”
BackgroundKöhnen, M., Kriston, L., Härter, M. C., Baumeister, H., & Liebherz, S. (2020) · Journal of Medical Internet Research · doi:10.2196/24584 · Cited by 11
Self-citation
Metadata
- Authors
- Köhnen, M., Kriston, L., Härter, M., Dirmaier, J., & Liebherz, S.
- Affiliations
- University Medical Center Hamburg-Eppendorf (DE)
- Corresponding author
- Köhnen, Moritz
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2019-03
- Volume
- 9
- Issue
- 3
- Pages
- e028042
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC6475157
- OpenAlex
- W2924253295
- Semantic Scholar
- b9afdeb5b0f9c8fded648b4f1757326cdc4ae1a8
- Cited by
- 10
- References
- 78
- Citations by year
- 2025: 2 · 2024: 2 · 2022: 2 · 2021: 1 · 2020: 3
- FWCI
- 0.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (acceptedVersion)
- Funders
- Bundesministerium für Bildung und Forschung
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- depression, digital mental health, treatment gap, waiting lists, acute treatment, follow-up care, treatment acceptance, dropout, major depressive disorder, depressive symptoms, access to mental health care
- MeSH terms
- Smartphone, Systematic Reviews as Topic, Depression, Humans, Patient Acceptance of Health Care, Psychotherapy, Self Care, Therapy, Computer-Assisted, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management. https://app.cochat.ai/papers/10.1136/bmjopen-2018-028042
- The paper
- Köhnen, M., Kriston, L., Härter, M., Dirmaier, J., & Liebherz, S. (2019). Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management. BMJ Open. https://doi.org/10.1136/bmjopen-2018-028042
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.