CoChat

Evaluating the Effectiveness of an E-Mental Health Intervention for People Living in Lebanon: Protocol for Two Randomized Controlled Trials

Open access
van 't Hof, Edith, Heim, Eva, Abi Ramia, Jinane, Burchert, Sebastian, Cornelisz, Ilja, Cuijpers, Pim, El Chammay, Rabih, Harper Shehadeh, Melissa, Noun, Philip, Smit, Filip, van Klaveren, Chris, van Ommeren, Mark, Zoghbi, Edwina, Carswell, Kenneth · 2021 · JMIR Research Protocols

Published version of a preprint

The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index; 14 of the 49 sources its claims cite were checked for support.

Abstract

Background: The lack of availability of evidence-based services for people exposed to adversity globally has led to the development of psychological interventions with features that will likely make them more scalable. The evidence for the efficacy of e-mental health from high-income countries is compelling, and the use of these interventions could be a way to increase the coverage of evidence-based psychological interventions in low- and middle-income countries. Step-by-Step is a brief (5-session) intervention proposed by the World Health Organization as an innovative approach to reducing the suffering and disability associated with depression. Objective: This study aims to evaluate the effectiveness and cost-effectiveness of a locally adapted version of Step-by-Step with Syrian nationals (trial 1) and Lebanese nationals and other populations residing in Lebanon (trial 2). Methods: This Step-by-Step trial involves 2 parallel, two-armed, randomized controlled trials comparing the e-intervention Step-by-Step to enhanced care as usual in participants with depressive symptoms and impaired functioning. The randomized controlled trials are designed and powered to detect effectiveness in 2 populations: Syrians in Lebanon (n=568) and other people residing in Lebanon (n=568; Lebanese nationals and other populations resident in Lebanon). The primary outcomes are depressive symptomatology (measured with the Patient Health Questionnaire-9) and functioning (measured with the World Health Organization Disability Assessment Scale 2.0). Secondary outcomes include anxiety symptoms, posttraumatic stress disorder symptoms, personalized measures of psychosocial problems, subjective well-being, and economic effectiveness. Participants are mainly recruited through online advertising. Additional outreach methods will be used if required, for example through dissemination of information through partner agencies and organizations. They can access the intervention on a computer, tablet, and mobile phone through a hybrid app. Step-by-Step has 5 sessions, and users are guided by trained nonspecialist “e-helpers” providing phone-based or message-based support for around 15 minutes a week. Results: The trials were funded in 2018. The study protocol was last verified June 20, 2019 (WHO ERC.0002797) and registered with ClinicalTrials.gov (NCT03720769). The trials started recruitment as of December 9, 2019, and all data collection was completed in December 2020. Conclusions: The Step-by-Step trials will provide evidence about the effectiveness of an e-mental health intervention in Lebanon. If the intervention proves to be effective, this will inform future scale-up of this and similar interventions in Lebanon and in other settings across the world. Trial Registration: ClinicalTrials.gov NCT03720769; https://clinicaltrials.gov/ct2/show/NCT03720769 International Registered Report Identifier (IRRID): DERR1-10.2196/21585

Overview

CoChat Summary

TL;DR

This paper is a protocol for two parallel randomized controlled trials testing WHO’s 5-session Step-by-Step e-mental health intervention in Lebanon, one with Syrians in Lebanon and one with other people residing in Lebanon. It is designed to compare Step-by-Step with enhanced care as usual on depressive symptoms, functioning, and cost-effectiveness.

Key findings

  • Not stated in the paper.
  • The trials were powered for a moderate effect size of Cohen d = 0.5, with 90% power and α = .05; each trial required 85 participants per arm, and accounting for 70% dropout led to a target recruitment of 568 participants per trial.
  • The primary outcomes are depressive symptoms (PHQ-9) and functioning (WHODAS 2.0), assessed at posttreatment 8 weeks after baseline; secondary outcomes include anxiety (GAD-7), PTSD symptoms (PCL-5), subjective well-being (WHO-5), personalized problems (PSYCHLOPS), satisfaction (CSQ-3), and service use (adapted CSRI).
  • In a prior feasibility RCT, complete-case postassessment results showed significant reductions in depressive symptoms, anxiety, and posttraumatic stress, and improvements in functioning and well-being; the ITT analysis showed a marginally nonsignificant effect on functioning and a trend in the expected direction for other measures.

Methods

  • Two pragmatic, parallel, 2-arm RCTs compare Step-by-Step with enhanced care as usual in adults residing in Lebanon: one trial with Syrians in Lebanon and one with Lebanese nationals and other populations residing in Lebanon.
  • Participants are adults aged over 18 years, Arabic- or English-speaking, with internet-connected device access, PHQ-9 scores ≥10, and WHODAS scores >16; people under 18 and those reporting serious thoughts or a plan to end their life are excluded.
  • Recruitment is mainly through online advertising/social media; randomization is 1:1 via app-based permuted blocks; analyses include ITT and completers’ analyses, with multiple imputation, regression models, Lee bounds, and cost-effectiveness analysis using the ICER.

Limitations

  • The paper states that the feasibility RCT was not powered to evaluate treatment effects, which is why fully powered RCTs were needed.
  • A 70% dropout rate was assumed for sample size planning, indicating substantial attrition risk in this type of e-mental health study.
  • The text makes evident that the study relies heavily on online recruitment and digital delivery, which may limit reach to people without internet-connected devices or sufficient digital access; this is not stated as a limitation by the authors.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/21585

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Flow chart of the study procedures.
Figure 1 Flow chart of the study procedures.CC BY · PubMed Central
Figure 2 Schedule of enrollment, interventions, and assessments for Step-by-Step (SPIRIT figure). CSQ: Client Satisfaction Questionnaire 3; GAD: Generalized Anxiety Disorder; PCL-5: PTSD Checklist for DSM-5; PHQ: Patient Health Questionnaire; PSYCHLOPS: Psychological Outcomes Profile Instrument; SRI: Service Receipt Inventory; WHO: World Health Organization; WHODAS: World Health Organization Disability Assessment Scale.
Figure 2 Schedule of enrollment, interventions, and assessments for Step-by-Step (SPIRIT figure). CSQ: Client Satisfaction Questionnaire 3; GAD: Generalized Anxiety Disorder; PCL-5: PTSD Checklist for DSM-5; PHQ: Patient Health Questionnaire; PSYCHLOPS: Psychological Outcomes Profile Instrument; SRI: Service Receipt Inventory; WHO: World Health Organization; WHODAS: World Health Organization Disability Assessment Scale.CC BY · PubMed Central

Verification

Claims the paper makes

9 Valid · 0 Not valid · 32 Not checked · 33 Own results and interpretations

14 more claims

Create a free account to see all 74 claims and to verify the 35 references still open.

See all claims — free account
  • It may state two separate claims as one. 23
  • Probably not a substantial claim. 44

Create a free account to see these claims.

Citations

Cites

Show all 47 references

Cited by

See all 16

Metadata

Authors
van 't Hof, E., Heim, E., Abi Ramia, J., Burchert, S., Cornelisz, I., Cuijpers, P., El Chammay, R., Harper Shehadeh, M., Noun, P., Smit, F., van Klaveren, C., van Ommeren, M., Zoghbi, E., & Carswell, K.
Affiliations
  • University of Zurich (CH)
  • Freie Universität Berlin (DE)
  • Vrije Universiteit Amsterdam (NL)
  • Amsterdam Public Health (NL)
  • Ministry of Public Health (LB)
  • World Health Organization (CH)
Venue
JMIR Research Protocols
Published
2021-01-28
Volume
10
Issue
1
Pages
e21585
ISSN
1929-0748 (ISSN-L)
OpenAlex
W3100416910
Cited by
16
References
47
Citations by year
2026: 2 · 2025: 1 · 2024: 4 · 2023: 3 · 2022: 4 · 2021: 1
FWCI
2.03
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Research Protocols (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Research Publications (Maastricht University) (publishedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by)
  • Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • VU Research Portal (submittedVersion, other-oa)
  • SERVAL (Université de Lausanne) (submittedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
  • Research Publications (Maastricht University) (submittedVersion, cc-by)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver (cc-by)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
World Health Organization
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
Keywords
e-mental health, depression, Syrian refugees, post-traumatic stress disorder, anxiety, mental health apps, cost-effectiveness, low- and middle-income countries, hybrid mobile applications, local adaptation, functioning, subjective well-being, online recruitment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.