Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial
Open accessPublished version of a preprint
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index; 7 of the 24 sources its claims cite were checked for support.
Abstract
Background: During the COVID-19 pandemic, health care professionals experienced high levels of depression. However, extant research has not highlighted effective internet-based psychological interventions to improve the mental health in this population during the pandemic. It remains unclear whether self-guided, internet-based cognitive behavioral therapy (iCBT) programs are effective in improving the mental health of health care workers during the COVID-19 pandemic. Objective: The aim of this study was to evaluate the effectiveness of a smartphone-based iCBT stress management program for reducing the depression experienced by nurses in Vietnam and Thailand. Methods: From March to April 2022, a 2-arm, parallel-group randomized controlled trial was implemented. One arm offered a 7-week self-guided iCBT program, and the other offered treatment as usual as a control arm. Full-time nurses were recruited from 6 hospitals: 2 hospitals in Vietnam and 4 hospitals in Thailand. The primary outcome of this program was the severity of depression measured by the Depression Anxiety Stress Scale-21 items. Follow-up surveys were conducted to measure the change in depression severity at 3 months (July-August 2022) and at 6 months (October-November 2022) after baseline. Mixed modeling for repeated measures was used to test the effects of the intervention compared with the control for the follow-up. Results: A total of 1203 nurses were included in this study: 602 in the intervention group and 601 in the control group. The follow-up rate at 3 and 6 months ranged from 85.7% (515/601) to 87.5% (527/602). The completion rate for the program was 68.1% (410/602). The group difference in depression was significant at the 3-month follow-up (coefficient=–0.92, 95% CI –1.66 to –0.18; P=.02) and nonsignificant at the 6-month follow-up (coefficient=–0.33, 95% CI –1.11 to 0.45; P=.41). The estimated effect sizes were –0.15 and –0.06 at the 3- and 6-month follow-ups, respectively. Conclusions: Our study shows that the smartphone-based iCBT program was effective in reducing depression at the 3-month follow-up among hospital nurses in Vietnam and Thailand during the COVID-19 pandemic. However, the effect size was small, and therefore, these results may not be clinically meaningful. Trial Registration: UMIN Clinical Trials Registry UMIN000044145; https://center6.umin.ac.jp/cgi-open-bin/ctr/ctr_view.cgi?recptno=R000050128 International Registered Report Identifier (IRRID): RR2-10.20944/preprints202303.0450.v1
Overview
CoChat Summary
## TL;DR
This 2-arm randomized controlled trial found that a 7-week smartphone-based self-guided iCBT stress management program significantly reduced depression at 3 months among hospital nurses in Vietnam and Thailand during COVID-19. The effect was small (estimated effect size −0.15) and was no longer significant at 6 months.
## Key findings
- Among 1,203 nurses (602 intervention, 601 control), depression improved more in the intervention group at 3 months: coefficient = −0.92, 95% CI −1.66 to −0.18; P = .02.
- The effect was not significant at 6 months: coefficient = −0.33, 95% CI −1.11 to 0.45; P = .41.
- Estimated effect sizes were −0.15 at 3 months and −0.06 at 6 months; the paper says the 3-month effect was small and “may not be clinically meaningful.”
- In the prevention subgroup analysis among participants without baseline depression (n = 931), new mild depression at 3 months was 7.8% (36/462) in the intervention group vs 10.4% (49/469) in controls, but this was not significant (OR = 0.70, 95% CI 0.45-1.10; P = .12).
## Methods
- Design: Open-label 2-arm, parallel-group randomized controlled trial conducted from March to April 2022 with follow-up at 3 and 6 months.
- Sample/data: Full-time registered nurses from 6 hospitals in Vietnam (2) and Thailand (4) who could access the internet by mobile device; 1,203 participants were included after screening.
- Analysis: Primary outcome was depressive symptoms on the DASS-21; the main analysis used mixed modeling for repeated measures with intention-to-treat, and a post hoc subgroup analysis used logistic regression for incident mild depression among those without baseline depression.
## Limitations
- The paper states there was possible attrition bias; if less motivated participants dropped out, the effect could be overestimated.
- Because this was a psychosocial intervention, participants and researchers could not be blinded; the authors note intervention participants may have underreported depression, and contamination between groups could have underestimated the effect.
- The paper says generalizability may be limited because participants came from a limited number of large provincial hospitals; it may not apply to other countries or settings, and the Thailand sample may not represent all nurses at the target hospitals.
- Evident from the text: the intervention’s benefit was short-lived, with significance at 3 months but not 6 months, which limits inference about durability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 Valid · 0 Not valid · 16 Not checked · 91 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that a self-guided iCBT program reduced depression among nurses in Vietnam during a 3-month follow-up [16].”
- Also stated in: § Interventions · plain
“Modules 1-6 had been developed using the modules of the previous iCBT program that had successfully reduced depression, as seen at the 3-month follow-up among nurses in Vietnam [16].”
§ Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial > Introduction > Background
What the sources say
- Supportedcites [16] source
The Discussion (passage 1) states that Program B, an iCBT program with fixed-sequential modules, showed a significant intervention effect on depressive symptoms at 3-month follow-up among hospital nurses in Vietnam (Cohen's d -0.18), and the Abstract reports p = 0.048 at 3 months but not at 7 months. The Discussion (passage 5) explicitly characterizes these iCBT programs as 'fully automated and self-guided'. Population, delivery mode, outcome and follow-up window all match the claim; the effect was small, which the citing sentence does not misrepresent. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Interventions · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“During the COVID-19 pandemic, health care professionals experienced high levels of depression, anxiety, and posttraumatic stress symptoms [2].”
§ Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial > Introduction > Background
What the sources say
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
The meta-analysis supports high levels of depression, anxiety and PTSD symptoms during COVID-19: the Abstract/Results (p. n/a) report pooled prevalences of 28.5% depression, 28.7% anxiety and 25.5% PTSD across 401 studies, and the Discussion subsection 'Healthcare professions' states these symptoms 'were highly prevalent across all studied healthcare professions'. However, the source's population is bounded to hospital healthcare workers (458,754 participants in 58 countries), not health care professionals generally — it in fact criticises Bell and Wade (2020) for 'conflating hospital HCWs with general HCWs' (Discussion, 'Frontline setting'). It also qualifies the PTSD element, noting HCW PTSD rates (25.5%) were 'comparable to the general public' (23.2%), unlike depression and anxiety, which exceeded general-public estimates (Discussion, p. n/a). (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our study of an unguided universal prevention iCBT program among nurses in Vietnam reported a small effect size on depression (d=0.18 at the 3-month follow-up) [16].”
§ Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial > Methods > Sample Size Calculation
What the sources say
- Supportedcites [16] source
The Abstract (p. 1) reports that Program B, the fixed-order iCBT program, showed a statistically significant effect on depressive symptoms at 3-month follow-up with Cohen's d = −0.18 (95% CI −0.34 to −0.02) among hospital nurses in Hanoi, Vietnam. The Discussion (p. 8) characterises the programs as 'fully automated and self-guided' (i.e., unguided) and states the effect size was −0.18 at 3-month follow-up, and the Introduction/Discussion frame Program B as universal prevention targeting all nurses regardless of symptoms, concluding 'The Program B may be useful when it is applied as the universal prevention.' Population, delivery mode, prevention type, magnitude and time point all match the citing sentence. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Very few studies have highlighted effective interventions that can improve the mental health of health care workers during infectious disease epidemics such as SARS, Ebola, and Middle East respiratory syndrome [3].”
§ Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial > Introduction > Background
What the sources say
- Partly supportedcites [3] sourceExperimental — accuracy not yet measured
The Discussion (Limitations of available evidence and future research needs) says only four studies assessed interventions for healthcare workers’ mental health, supporting the claim that studies are few. But it says none was a randomized trial and that robust trials are needed to identify effective interventions; the Results rate confidence in the intervention evidence as very low. The source therefore does not establish that the interventions are effective. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A similar pattern was observed in our previous RCT using a similar self-guided smartphone-based stress management program among hospital nurses in Vietnam before the COVID-19 pandemic [16].”
§ Effectiveness of a Smartphone-Based Stress Management Program for Depression in Hospital Nurses During COVID-19 in Vietnam and Thailand: 2-Arm Parallel-Group Randomized Controlled Trial > Discussion > Principal Results
What the sources say
- Supportedcites [16] source
The cited paper is exactly the previous RCT the sentence identifies: a three-arm randomized trial of smartphone-based stress management programs among nurses at a large general hospital in Hanoi, Vietnam (Abstract; Introduction > Objective). Its Methods > Intervention programs state the programs were '(6) ... fully-automated and self-guided, provided without any professional or therapist support', echoed in the Discussion ('the iCBT programs in the present study were fully automated and self-guided'). Results > Recruitment fixes the timing before the pandemic: baseline in September 2018 with 3- and 7-month follow-ups in January and May 2019, and the Introduction frames this study against the later 'new normal' era during and after the outbreak. The 'similar pattern' itself is the citing authors' comparison and is not a point attributed to this source. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
39 more claims
Create a free account to see all 114 claims and to verify the 17 references still open.
- Probably not a substantial claim. 51
- It may state two separate claims as one. 33
- The quote only partly states this claim. 1
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 1×
“The statistical power was calculated using the G*Power version 3.1.9.2 [35].”
InfluentialCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Henry, J. D., & Crawford, J. R. (2005) · British Journal of Clinical Psychology · doi:10.1348/014466505x29657 · Cited by 5,801 · cited 2×
“The DASS21 depression score can range from 0 to 42, with higher scores indicating more severe depression; a cut-off score of 10 indicates mild depression [31].”
The World Health report 2006 1 : Working together for health 2
Guilbert, J.-J. (2006) · Education for Health: Change in Learning & Practice · doi:10.1080/13576280600937911 · Cited by 2,654
Online mental health services in China during the COVID-19 outbreak
Liu, S., Yang, L., Zhang, C., Xiang, Y.-T., Liu, Z., Hu, S., & Zhang, B. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30077-8 · Cited by 1,992 · cited 1×
“As close face-to-face personal contact was limited to prevent the spread of COVID-19 in an organization or community, using information and communication technology to provide training on stress management skills, such as internet stress management programs [12], has been encouraged [13].”
Eysenbach, G., & CONSORT-EHEALTH Group (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1923 · Cited by 1,863 · cited 1×
“This report of a randomized trial conforms to the guidelines in the CONSORT (Consolidated Standards of Reporting Trials) [24,25] (Multimedia Appendix 1).”
Cognitive Therapy of Depression
Fischer, H. K. (1980) · Psychosomatics · doi:10.1016/s0033-3182(80)73639-3 · Cited by 1,612
Cénat, J. M., Blais-Rochette, C., Kokou-Kpolou, C. K., Noorishad, P.-G., Mukunzi, J. N., McIntee, S.-E., Dalexis, R. D., Goulet, M.-A., & Labelle, P. R. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2020.113599 · Cited by 952 · cited 1×
“The COVID-19 pandemic started in late December 2019 and is still impacting the physical and mental health of people worldwide [1].”
Serrano-Ripoll, M. J., Meneses-Echavez, J. F., Ricci-Cabello, I., Fraile-Navarro, D., Fiol-deRoque, M. A., Pastor-Moreno, G., Castro, A., Ruiz-Pérez, I., Zamanillo Campos, R., & Gonçalves-Bradley, D. C. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.034 · Cited by 592 · cited 1×
“Very few studies have highlighted effective interventions that can improve the mental health of health care workers during infectious disease epidemics such as SARS, Ebola, and Middle East respiratory syndrome [3].”
Tran, T. D., Tran, T., & Fisher, J. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-24 · Cited by 476 · cited 1×
“Vietnamese and Thai versions of DASS21 were developed and tested, and their internal consistency (Cronbach α ) and validity were confirmed in previous studies [32,33].”
Self-citation
Research works printed but not linked: 1
- Shatri, H, 2021, Acta Med Indones, 53, 225
Cited by
Chau, L. W., Lam, R. W. M., Minas, H., Hayashi, K., Nguyen, V. C., & O’Neil, J. (2025) · JMIR Mental Health · doi:10.2196/68296 · Cited by 39
“A total of 24 articles re-ported on cultural adaptation [48,53,64,67,68, 70,80,87,89,90,92, 93,95,104,105,108,110, 112,117,119,122,124,125].”
López-del-Hoyo, Y., Fernández-Martínez, S., Perez-Aranda, A., Monreal-Bartolomé, A., Barceló-Soler, A., Camarero-Grados, L., Armas-Landaeta, C., Guzmán-Parra, J., Carbonell, V., Campos, D., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/59653 · Cited by 9
“Anxiety and depressive symptomatology were reduced after the intervention, which is in line with previous eHealth CBT-based interventions [67,68] and third-wave psychotherapies [69,70].”
Wang, H., Xiao, Y., Yao, H., Wen, Y., Deng, M., Yang, W. Y. L., & Mao, X. (2025) · BMC Nursing · doi:10.1186/s12912-025-03559-y · Cited by 8
“Four studies [32–35]”
InfluentialMaulana, I., Shalahuddin, I., Eriyani, T., & Pebrianti, S. (2025) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s566502 · Cited by 3
“29,35,37 Coaching, AI-assisted, and resilience-enhancing programs were less frequent but showed strong potential in reducing burnout and enhancing work engagement in non-pandemic contexts.”
Salutogenic Principles in Workplace Health Promotion Interventions: A Scoping Review
Wrede, S., Gärtner, I.-M., & Mortsiefer, A. (2026) · Journal of Prevention · doi:10.1007/s10935-026-00915-9 · Cited by 2
Metadata
- Authors
- Watanabe, K., Tran, T. T. T., Sripo, N., Sakuraya, A., Imamura, K., Boonyamalik, P., Sasaki, N., Tienthong, T., Asaoka, H., Iida, M., Nguyen, Q. T., Nguyen, N. T., Vu, S. T., Ngo, T. T., Luyen, T. T., Nguyen, L. D., Nguyen, N. T. V., Nguyen, B. T., Matsuyama, Y., Takemura, Y., Nishi, D., Tsutsumi, A., Nguyen, H. T., Kaewboonchoo, O., & Kawakami, N.
- Affiliations
- Kitasato University (JP)
- Hanoi School Of Public Health (VN)
- Chulabhorn Royal Academy (TH)
- The University of Tokyo (JP)
- Mahidol University (TH)
- Bệnh viện Đa khoa Xanh Pôn (VN)
- Thong Nhat Hospital (VN)
- University of Tokyo Hospital (JP)
- Corresponding author
- Kawakami, Norito
- ORCID
- Watanabe, Kazuhiro
- Tran, Thuy Thi Thu
- Sripo, Narisara
- Sakuraya, Asuka
- Imamura, Kotaro
- Boonyamalik, Plernpit
- Sasaki, Natsu
- Tienthong, Thanate
- Asaoka, Hiroki
- Iida, Mako
- Nguyen, Quynh Thuy
- Nguyen, Nga Thi
- Vu, Son Thai
- Ngo, Thuy Thi
- Luyen, Tham Thi
- Nguyen, Long Duc
- Nguyen, Nga Thi Viet
- Nguyen, Binh Thanh
- Matsuyama, Yutaka
- Takemura, Yukie
- Nishi, Daisuke
- Tsutsumi, Akizumi
- Nguyen, Huong Thanh
- Kaewboonchoo, Orawan
- Kawakami, Norito
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-08-30
- Volume
- 26
- Pages
- e50071
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC11399744
- OpenAlex
- W4402048229
- Cited by
- 8
- References
- 35
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 1
- FWCI
- 3.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Japan Society for the Promotion of Science (20KK0215)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Maternal Mental Health During Pregnancy and Postpartum
- Keywords
- depression, hospital nurses, COVID-19 pandemic, internet-based cognitive behavioral therapy, smartphone-based intervention, stress management, Vietnam, Thailand, cross-cultural comparison, program completion rates, follow-up retention
- MeSH terms
- Smartphone, COVID-19, SARS-CoV-2, Adult, Depression, Female, Humans, Male, Middle Aged, Nursing Staff, Hospital, Stress, Psychological, Thailand, Vietnam, Cognitive Behavioral Therapy, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
