Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials
Open accessPublished version of a preprint
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index; 14 of the 49 sources its claims cite were checked for support.
Abstract
Background: The lack of availability of evidence-based services for people exposed to adversity globally has led to the development of psychological interventions with features that will likely make them more scalable. The evidence for the efficacy of e-mental health from high-income countries is compelling, and the use of these interventions could be a way to increase the coverage of evidence-based psychological interventions in low- and middle-income countries. Step-by-Step is a brief (5-session) intervention proposed by the World Health Organization as an innovative approach to reducing the suffering and disability associated with depression. Objective: This study aims to evaluate the effectiveness and cost-effectiveness of a locally adapted version of Step-by-Step with Syrian nationals (trial 1) and Lebanese nationals and other populations residing in Lebanon (trial 2). Methods: This Step-by-Step trial involves 2 parallel, two-armed, randomized controlled trials comparing the e-intervention Step-by-Step to enhanced care as usual in participants with depressive symptoms and impaired functioning. The randomized controlled trials are designed and powered to detect effectiveness in 2 populations: Syrians in Lebanon (n=568) and other people residing in Lebanon (n=568; Lebanese nationals and other populations resident in Lebanon). The primary outcomes are depressive symptomatology (measured with the Patient Health Questionnaire-9) and functioning (measured with the World Health Organization Disability Assessment Scale 2.0). Secondary outcomes include anxiety symptoms, posttraumatic stress disorder symptoms, personalized measures of psychosocial problems, subjective well-being, and economic effectiveness. Participants are mainly recruited through online advertising. Additional outreach methods will be used if required, for example through dissemination of information through partner agencies and organizations. They can access the intervention on a computer, tablet, and mobile phone through a hybrid app. Step-by-Step has 5 sessions, and users are guided by trained nonspecialist “e-helpers” providing phone-based or message-based support for around 15 minutes a week. Results: The trials were funded in 2018. The study protocol was last verified June 20, 2019 (WHO ERC.0002797) and registered with ClinicalTrials.gov (NCT03720769). The trials started recruitment as of December 9, 2019, and all data collection was completed in December 2020. Conclusions: The Step-by-Step trials will provide evidence about the effectiveness of an e-mental health intervention in Lebanon. If the intervention proves to be effective, this will inform future scale-up of this and similar interventions in Lebanon and in other settings across the world. Trial Registration: ClinicalTrials.gov NCT03720769; https://clinicaltrials.gov/ct2/show/NCT03720769 International Registered Report Identifier (IRRID): DERR1-10.2196/21585
Overview
CoChat Summary
TL;DR
This paper is a protocol for two parallel randomized controlled trials testing WHO’s 5-session Step-by-Step e-mental health intervention in Lebanon, one with Syrians in Lebanon and one with other people residing in Lebanon. It is designed to compare Step-by-Step with enhanced care as usual on depressive symptoms, functioning, and cost-effectiveness.
Key findings
- Not stated in the paper.
- The trials were powered for a moderate effect size of Cohen d = 0.5, with 90% power and α = .05; each trial required 85 participants per arm, and accounting for 70% dropout led to a target recruitment of 568 participants per trial.
- The primary outcomes are depressive symptoms (PHQ-9) and functioning (WHODAS 2.0), assessed at posttreatment 8 weeks after baseline; secondary outcomes include anxiety (GAD-7), PTSD symptoms (PCL-5), subjective well-being (WHO-5), personalized problems (PSYCHLOPS), satisfaction (CSQ-3), and service use (adapted CSRI).
- In a prior feasibility RCT, complete-case postassessment results showed significant reductions in depressive symptoms, anxiety, and posttraumatic stress, and improvements in functioning and well-being; the ITT analysis showed a marginally nonsignificant effect on functioning and a trend in the expected direction for other measures.
Methods
- Two pragmatic, parallel, 2-arm RCTs compare Step-by-Step with enhanced care as usual in adults residing in Lebanon: one trial with Syrians in Lebanon and one with Lebanese nationals and other populations residing in Lebanon.
- Participants are adults aged over 18 years, Arabic- or English-speaking, with internet-connected device access, PHQ-9 scores ≥10, and WHODAS scores >16; people under 18 and those reporting serious thoughts or a plan to end their life are excluded.
- Recruitment is mainly through online advertising/social media; randomization is 1:1 via app-based permuted blocks; analyses include ITT and completers’ analyses, with multiple imputation, regression models, Lee bounds, and cost-effectiveness analysis using the ICER.
Limitations
- The paper states that the feasibility RCT was not powered to evaluate treatment effects, which is why fully powered RCTs were needed.
- A 70% dropout rate was assumed for sample size planning, indicating substantial attrition risk in this type of e-mental health study.
- The text makes evident that the study relies heavily on online recruitment and digital delivery, which may limit reach to people without internet-connected devices or sufficient digital access; this is not stated as a limitation by the authors.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
9 Valid · 0 Not valid · 32 Not checked · 33 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“It has been carefully designed and comprehensively adapted for use in Lebanon (including for refugees residing in Lebanon [20]).”
§ Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials > Introduction
What the sources say
- Supportedcites [20] source
The Introduction says Step-by-Step was adapted for Lebanon with Lebanese, Palestinian and Syrian populations in mind. The Methods describe translation reviewed by people from all three groups, and the Discussion describes a systematic adaptation process that led to substantial content and illustration changes. The cited paper therefore supports the claim that the intervention was carefully adapted for use in Lebanon, including among refugee communities. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In high-income countries, guided, online, self-help programs have been found to be as effective as the same interventions provided face-to-face [9-11].”
§ Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials > Introduction
What the sources say
- Not checked yetcites [9] source
- Partly supportedcites [10] sourceExperimental — accuracy not yet measured
Our copy directly supports the equivalence half of the claim: section 3.3.5 'Face to face CBT vs iCBT' pools nine head-to-head trials (568 subjects) and reports the difference as non-significant, g = 0.14 in favour of face-to-face CBT (95% CI -0.04-0.32), and the Introduction states 'iCBT has been shown to be equally effective as face-to-face CBT', echoing Andersson et al. (2014) and Olthuis et al. (2015). The interventions compared are indeed guided, internet-delivered self-help CBT courses, so that element holds. What this source does not state is the 'in high-income countries' scoping: its inclusion criterion was English-language RCTs (section 2.1) and no passage addresses country income level, so the geographical/economic qualifier is the citing authors' framing rather than something attributed by this paper. (LLM, conf=0.72)
- Partly supportedcites [11] sourceExperimental — accuracy not yet measured
The Abstract (p. 3) and Discussion (p. 16) state the core of the claim: pooled post-treatment Hedges g = .05 (95% CI -.09 to .20) across 20 trials of guided ICBT directly compared with face-to-face CBT, 'indicating that the two treatment formats are equally effective' for the conditions studied. However, the source does not frame or test this by country income level (it only lists the trial countries: Australia, Finland, the Netherlands, Spain, Sweden, Switzerland, the USA; Studies included, p. 7), so the 'in high-income countries' qualifier is not this paper's finding. The paper also bounds the conclusion to CBT-based guided ICBT, explicitly cautioning that 'we cannot... conclude that ICBT and face-to-face therapy are equally effective on all conditions' (Discussion, p. 15) and that 'more research... is needed to establish the general equivalence of the two treatment formats' (Abstract, p. 3), whereas the claim generalizes to online self-help programs and 'the same interventions' more broadly. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The scale has demonstrated sensitivity to change in well-being and is available in multiple languages.”
§ Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials > Methods > Outcome Measures
What the sources say
- Partly supportedcites [35] sourceExperimental — accuracy not yet measured
The Results and Discussion (pages unavailable) report that the WHO-5 distinguished respondents who reported worse global health over the past year from those who did not. Because the study grouped respondents by retrospectively reported global-health change, it does not directly demonstrate sensitivity to change in well-being itself. (LLM, conf=0.84)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
In the paper
“Only 1 in 9 respondents with a mental disorder had ever obtained any treatment.”
§ Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials > Introduction
What the sources say
- Not checked yetcites [6] source
plainn = 2,857- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“More recent data show that the situation has improved, but treatment seeking still remains low, with a treatment gap of approximately 80% [7].”
§ Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials > Introduction
What the sources say
- Not checked yetcites [7] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
14 more claims
Create a free account to see all 74 claims and to verify the 35 references still open.
- It may state two separate claims as one. 23
- Probably not a substantial claim. 44
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 3×
“The primary outcomes are levels of depressive symptoms measured with the PHQ-9 [31] and levels of functioning measured with the WHODAS 2.0 [32] at posttreatment (8 weeks after baseline).”
BackgroundMethodInfluentialA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 2×
“Secondary outcomes include levels of subjective well-being (WHO-5) [35], levels of anxiety symptoms (Generalized Anxiety Disorder-7 [GAD-7]) [36], and levels of PTSD symptoms (PTSD Checklist for DSM-5 [PCL-5]) [37].”
BackgroundAn Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ–4
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2009) · Psychosomatics · doi:10.1016/s0033-3182(09)70864-3 · Cited by 4,261 · cited 3×
“E-helpers will have access to the weekly depression scores (measured with the PHQ-4) of the participants and can therefore monitor distress levels over the course of the intervention.”
Method(2004) · JAMA · doi:10.1001/jama.291.21.2581 · Cited by 3,448 · cited 1×
“%) of people suffering from mental disorders receive no treatment at all [1].”
BackgroundAssessment of client/patient satisfaction: development of a general scale
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., & Nguyen, T. D. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90094-6 · Cited by 2,887 · cited 2×
“The CSQ [39] is an easily scored and administered 8-item measure that is designed to measure client satisfaction with mental health services.”
BackgroundMethodConsolidated Health Economic Evaluation Reporting Standards (CHEERS) statement
Husereau, D., Drummond, M., Petrou, S., Carswell, C., Moher, D., Greenberg, D., Augustovski, F., Briggs, A. H., Mauskopf, J., Loder, E., et al. (2013) · BMJ · doi:10.1136/bmj.f1049 · Cited by 1,776
Charlson, F., van Ommeren, M., Flaxman, A., Cornett, J., Whiteford, H., & Saxena, S. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30934-1 · Cited by 1,702
Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects
LEE, D. S. (2009) · Review of Economic Studies · doi:10.1111/j.1467-937x.2009.00536.x · Cited by 1,399
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232 · cited 1×
“In high-income countries, guided, online, self-help programs have been found to be as effective as the same interventions provided face-to-face [9-11].”
BackgroundSelf-citationAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 1×
“In addition, such programs have been shown to reduce symptoms of mental disorders in routine care [12].”
Background
Cited by
Cuijpers, P., Heim, E., Abi Ramia, J., Burchert, S., Carswell, K., Cornelisz, I., Knaevelsrud, C., Noun, P., van Klaveren, C., van’t Hof, E., et al. (2022) · PLoS Medicine · doi:10.1371/journal.pmed.1004025 · Cited by 118
“A more extensive description of the measures can be found in the protocol paper [17].”
BackgroundSelf-citationHeim, E., Ramia, J. A., Hana, R. A., Burchert, S., Carswell, K., Cornelisz, I., Cuijpers, P., El Chammay, R., Noun, P., van Klaveren, C., et al. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100380 · Cited by 61
Self-citationGuided digital health intervention for depression in Lebanon: randomised trial
Cuijpers, P., Heim, E., Ramia, J. A., Burchert, S., Carswell, K., Cornelisz, I., Knaevelsrud, C., Noun, P., van Klaveren, C., van’t Hof, E., et al. (2022) · Evidence-Based Mental Health · doi:10.1136/ebmental-2021-300416 · Cited by 60
Self-citationChang, T. F. H., Ley, B. L., Ramburn, T. T., Srinivasan, S., Hariri, S., Purandare, P., & Subramaniam, B. (2022) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12341 · Cited by 38
Shala, M., Morina, N., Burchert, S., Cerga-Pashoja, A., Knaevelsrud, C., Maercker, A., & Heim, E. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100339 · Cited by 29
Metadata
- Authors
- van 't Hof, E., Heim, E., Abi Ramia, J., Burchert, S., Cornelisz, I., Cuijpers, P., El Chammay, R., Harper Shehadeh, M., Noun, P., Smit, F., van Klaveren, C., van Ommeren, M., Zoghbi, E., & Carswell, K.
- Affiliations
- University of Zurich (CH)
- Freie Universität Berlin (DE)
- Vrije Universiteit Amsterdam (NL)
- Amsterdam Public Health (NL)
- Ministry of Public Health (LB)
- World Health Organization (CH)
- ORCID
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-28
- Volume
- 10
- Issue
- 1
- Pages
- e21585
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC7878105
- OpenAlex
- W3100416910
- Cited by
- 16
- References
- 47
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 4 · 2023: 3 · 2022: 4 · 2021: 1
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by)
- Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- VU Research Portal (submittedVersion, other-oa)
- SERVAL (Université de Lausanne) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver (cc-by)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- World Health Organization
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- e-mental health, depression, Syrian refugees, post-traumatic stress disorder, anxiety, mental health apps, cost-effectiveness, low- and middle-income countries, hybrid mobile applications, local adaptation, functioning, subjective well-being, online recruitment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.