The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index; 50 of the 71 sources its claims cite were checked for support.
Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial
Open accessPublished version of a preprint
Abstract
Background: The COVID-19 pandemic has had an impact on mental health worldwide. Low- and middle-income countries were largely affected by it. Mexico was one of the most affected countries. Extended periods of lockdowns, isolation, and social distancing, among other factors, highlighted the need to introduce web-based psychological interventions to the Mexican population. In this context, Mental Health COVID-19 emerged as a self-guided web-based intervention (SGWI) aimed at adults to improve mental health during the COVID-19 pandemic. Objective: This study aims to assess the efficacy of 2 modalities of a self-guided intervention (with and without chat support) in reducing depression symptoms, generalized anxiety, community posttraumatic stress, widespread fear, anxiety, sleep quality, physiological and affective coping, and suicide ideation. In addition, it aimed to compare the moderating role of coping strategies, acceptance, and satisfaction in participants’ symptom reduction. We hypothesize that the self-guided, chat-supported modality will show higher efficacy than the modality without chat support in achieving clinical change and better performance as a moderator of depression symptoms, generalized anxiety, community posttraumatic stress, widespread fear, anxiety, sleep quality, physiological and affective coping, and suicide ideation, as well as an increase in participants’ satisfaction and acceptability. Methods: A randomized controlled trial was conducted. Data were collected from May 2020 to June 2022. We performed intrasubject measures at 4 evaluation periods: pretest, posttest, and follow-up measurements at 3 and 6 months. Differences between intervention groups were assessed through the Mann-Whitney U test for continuous variables and the chi-square test for categorical variables. Changes due to intervention were analyzed using Wilcoxon W test. Moderated regression analysis was performed to test the hypothesized moderating role of coping strategies, usability, and opinion about treatment on clinical change. Results: A total of 36 participants completed the intervention; of these, 5 (14%) were part of the SGWI group, and 31 (86%) were on the SGWI plus chat support (SGWI+C) group, which included a chat service with therapists. The perceived high complexity of the system for the SGWI group had a moderating effect associated with a lack of efficacy of the intervention regarding depression, but not when controlled for sociodemographic variables. A perception of lower helpfulness of the intervention was associated with poorer outcomes. Coping strategies did not show moderating effects. Conclusions: Enhancing the utility of web-based interventions for reducing clinical symptoms by incorporating a support chat to boost treatment adherence seemed to improve the perception of the intervention’s usefulness. Web-based interventions face several challenges, such as eliminating complexities in platform use and increasing the users’ perceived utility of the intervention, among other issues identified in the study. ©Alejandro Dominguez-Rodriguez, Sergio Sanz-Gomez, Leivy Patricia González Ramírez, Paulina Erika Herdoiza-Arroyo, Lorena Edith Trevino Garcia, Anabel de la Rosa-Gómez, Joel Omar González-Cantero, Valeria Macias-Aguinaga, Paulina Arenas Landgrave, Sarah Margarita Chávez-Valdez.
Overview
CoChat Summary
## TL;DR
This randomized controlled trial evaluated a self-guided web-based intervention for Mexican adults during COVID-19, with and without chat support, and found symptom reductions mainly in the chat-supported group. The paper also emphasizes that usability and perceived usefulness mattered for outcomes, while follow-up and retention were major challenges.
## Key findings
- A total of 36 participants completed the intervention; 31 (86%) were in the self-guided web-based intervention plus chat support group (SGWI+C) and 5 (14%) were in the self-guided group without chat support (SGWI).
- In the SGWI+C group, symptom reduction was statistically relevant with minor to medium-sized effects for depression (BDI-II), widespread fear, and state anxiety (STAI-state); the SGWI group did not show statistically significant changes in those same measures.
- In the total sample, there was a statistically significant change from pretest to posttest in depression (BDI-II), generalized fear, and anxiety (STAI, both state and trait scales), but generalized anxiety (GAD-7) did not show change.
- Moderation analyses found that perceived complexity mattered: “I found the system unnecessarily complex” was associated with worse depression outcomes (β=1.324; SE 0.390; P=.003), but this effect disappeared after controlling for age, gender, and educational attainment. Lower perceived usefulness of the intervention was also associated with poorer outcomes (β=0.799; SE 0.241; P=.005 at low scores).
## Methods
- Design: Randomized controlled clinical trial with 2 independent groups and repeated measures at 4 time points: pretest, posttest, 3-month, and 6-month follow-up.
- Sample/data: Adults in the Mexican population were recruited through social networks; 2047 people were screened, 608 were randomized, and 36 completed the intervention and pre/post assessment. Data were collected from May 2020 to June 2022.
- Analysis: Group differences were tested with Mann-Whitney U tests for continuous variables and chi-square tests for categorical variables; intervention change was analyzed with Wilcoxon W tests; moderation used regression models with PROCESS, bootstrapping (50,000 samples), and Johnson-Neyman intervals.
## Limitations
- The paper states that the main limitation was the small sample size for the SGWI group, which forced moderation analyses to be done on the total sample rather than by group, and the SGWI group had no follow-up data at 3 or 6 months.
- The sample was a nonprobabilistic convenience sample of people who accessed the platform and sought treatment, so the authors note the findings cannot be generalized to the Mexican population.
- There was a baseline difference in depressive symptoms between groups, and the paper says this limited pre-intervention comparability.
- Evident from the text: there was substantial attrition—of 608 randomized participants, only 36 completed the intervention and pre/post assessment; the SGWI group especially had much poorer follow-up completion.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
33 Valid · 4 Not valid · 15 Not checked · 87 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These interventions have shown to be as effective as in-person therapy [31,32] and provide solutions to the barriers of face-to-face treatments regarding flexibility, anonymity, low economic cost, ease of access, and the broad number of people who can potentially benefit from these mental health resources [26,33].”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Introduction > Background
What the sources say
- Partly supportedcites [31] sourceExperimental — accuracy not yet measured
The Discussion (p. 16) reports that guided internet-delivered CBT and face-to-face CBT were equally effective overall for the conditions studied. The claim extends this finding to web-based psychological interventions generally, but the Discussion (p. 15) says the review included only CBT and cautions against generalizing to other approaches. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [32] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“So, there is evidence that digital psychotherapeutic options are not inferior to their face-to-face counterparts [37].”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Introduction > Background
What the sources say
- Supportedcites [37] source
The Conclusions explicitly state that clinicians can be confident digital psychotherapeutic options are not inferior to their face-to-face counterparts. The paper discusses this in the context of treatment for depression and anxiety disorders. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Evidence suggests that internet-based treatments are effective for the treatment of anxiety disorders and depression [35,36].”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [35] source
- Partly supportedcites [36] sourceExperimental — accuracy not yet measured
The Discussion (page not provided) reports a large, significant effect of digital interventions for anxiety disorders compared with inactive controls. It says this meta-analysis was specific to anxiety disorders; although it mentions a prior review that included depression studies, it does not establish effectiveness for depression itself. (LLM, conf=0.88)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“For the analysis, the software G*Power (version 3.1.6 [54]) was used, and a required sample size of 128 participants was obtained (64 per group).”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Methods > Sample Size
What the sources say
- Supportedcites [54] source
The citation identifies G*Power as the software used. The paper’s Program Handling section describes G*Power 3 calculating required sample sizes for two-group analyses. The 128 participants (64 per group) is the citing authors’ calculation, not a result attributed to this source. (LLM, conf=0.87)
plainn = 128- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, it should be noted that the study by Wahlund et al [85] did not have an active control group.”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Discussion > Principal Findings
What the sources say
- Supportedcites [85] source
The Trial Design section states that participants were randomised to the intervention or a waiting list. The Discussion explicitly identifies the waiting-list control as a limitation and says future trials should include an active comparator. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
55 more claims · 4 with their cited sources checked
Create a free account to see all 139 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 45
- Probably not a substantial claim. 51
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Methods > Ethical Considerations
“This study was approved by the ethics committee of the Escuela Libre de Psicología, Universidad de Ciencias del Comportamiento (ethics committee of the Free School of Psychology University of Behavioral Science) in Chihuahua, Mexico (reference number Folio 2008), and registered in ClinicalTrials.gov (NCT04468893), and in the International Registered Report Identifier (IRRID; DERR1-10.2196/23117).”
§ Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial > Abstract > International Registered Report Identifier (IRRID)
“RR2-10.2196/23117”
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 1×
“For the analysis, the software G*Power (version 3.1.6 [54]) was used, and a required sample size of 128 participants was obtained (64 per group).”
MethodInfluentialThe Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research
Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989) · Psychiatry Research · doi:10.1016/0165-1781(89)90047-4 · Cited by 35,234 · cited 2×
“The Pittsburgh Sleep Quality Index [68] is self-administered 19-item questionnaire that assesses sleep quality and disturbances during the past month.”
BackgroundMethodA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“The GAD-7 [61] is a brief scale that consists of 7 items designed to measure the severity of symptoms of GAD.”
BackgroundThe psychological impact of quarantine and how to reduce it: Rapid review of the evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30460-8 · Cited by 16,378 · cited 2×
“Due to these conditions, an increase in negative psychological effects was found [5], particularly regarding stress, depression, and anxiety, as well a heightened risk for developing posttraumatic stress disorder (PTSD) [10] and the increased risk of suicide.”
BackgroundThe psychological impact of the COVID-19 epidemic on college students in China
Cao, W., Fang, Z., Hou, G., Han, M., Xu, X., Dong, J., & Zheng, J. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112934 · Cited by 5,843
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Assessment of suicidal intention: The Scale for Suicide Ideation.
Beck, A. T., Kovacs, M., & Weissman, A. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.47.2.343 · Cited by 3,419
Education and the COVID-19 pandemic
Daniel, S. J. (2020) · PROSPECTS · doi:10.1007/s11125-020-09464-3 · Cited by 2,425
Keyes, C. L. M. (2007) · American Psychologist · doi:10.1037/0003-066x.62.2.95 · Cited by 2,268 · cited 1×
“Thus, while traditional psychotherapy has consistently shown efficacy in reducing psychopathological aspects, people show dissatisfaction in some parts of their lives [20].”
BackgroundPositive psychology interventions: a meta-analysis of randomized controlled studies
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-119 · Cited by 1,996 · cited 1×
“Similarly, based on a meta-analysis [19], positive psychological interventions were found to effectively improve subjective and psychological well-being and reduce depressive symptoms.”
Background
Research works printed but not linked: 10
- BeckATSteerRABrownGKBeck Depression Inventory-II (BDI-II)APA PsycTests19962024-04-29https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft00742-000 · DOI · Paper page
- Jurado, S, 1998, Salud Mental, 21, 26
- Pineda, DA, 2002, Rev Neurol, 34, 911
- Ruiz Pérez, JI, 2007, Acta Colomb Psicol, 10, 65
- Chávez-Valdez, SM, 2018, Manejo de Miedo Juvenil: Afrontamiento Ante la Violencia e Ineficacia Social
- Spielberger, CD, 1975, Idare: Inventario de Ansiedad: Rasgo-Estado [Idare: anxiety inventory: state-trait]
- Jiménez-Genchi, A, 2008, Gac Med Mex, 144, 491
- Vuanello, R, 2006, Interdisciplinaria, 23, 17
- Miguel-Tobal, JJ, 1997, Inventario de Situaciones y Respuestas de Ansiedad (ISRA)
- Ruwaard, J, 2011, Stud Health Technol Inform, 167, 9
Cited by
Vieira, B. B., Savoy, L., Luna, K. P. A., Flahault, A., & Hasselgård-Rowe, J. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22040628 · Cited by 8
Metadata
- Authors
- Dominguez-Rodriguez, A., Sanz-Gomez, S., González Ramírez, L. P., Herdoiza-Arroyo, P. E., Trevino Garcia, L. E., de la Rosa-Gómez, A., González-Cantero, J. O., Macias-Aguinaga, V., Arenas Landgrave, P., & Chávez-Valdez, S. M.
- Affiliations
- Universidad Internacional del Ecuador (EC)
- Universidad de Guadalajara (MX)
- Universidad Autónoma de Ciudad Juárez (MX)
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-09-30
- Volume
- 8
- Pages
- e53767
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC11474119
- OpenAlex
- W4401548744
- Cited by
- 1
- References
- 87
- Citations by year
- 2025: 1
- FWCI
- 0.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Deposito de Investigacion Universidad de Sevilla (University of Seville) (submittedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Instituto Tecnológico y de Estudios Superiores de Monterrey
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- chat support, depressive symptoms, generalized anxiety disorder, COVID-19 pandemic mental health, coping strategies, acceptance and action, treatment satisfaction, suicidal ideation, sleep quality, moderated mediation, low- and middle-income countries, Mexico, digital mental health, treatment acceptability
- MeSH terms
- Internet-Based Intervention, COVID-19, Adaptation, Psychological, Adult, Anxiety, Depression, Female, Humans, Male, Mexico, Middle Aged, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial. https://app.cochat.ai/papers/10.2196/53767
- The paper
- Dominguez-Rodriguez, A., Sanz-Gomez, S., González Ramírez, L. P., Herdoiza-Arroyo, P. E., Trevino Garcia, L. E., de la Rosa-Gómez, A., González-Cantero, J. O., Macias-Aguinaga, V., Arenas Landgrave, P., & Chávez-Valdez, S. M. (2024). Evaluation and Future Challenges in a Self-Guided Web-Based Intervention With and Without Chat Support for Depression and Anxiety Symptoms During the COVID-19 Pandemic: Randomized Controlled Trial. JMIR Formative Research. https://doi.org/10.2196/53767
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
