Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial
Open accessThe DOI matches its Crossref record; 99 of the 103 references it cites were found in a registry or an index; 43 of the 78 sources its claims cite were checked for support.
Abstract
Background: Online psychological interventions have emerged as a treatment alternative because they are accessible, flexible, personalized, and available to large populations. The number of Internet interventions in Latin America is limited, as are Randomized Controlled Trials (RCTs) of their effectiveness and a few studies comparing their effectiveness in multiple countries at the same time. We have developed an online intervention, Well-being Online, which will be available to the public free of charge in 7 countries: Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands. We expect a reduction in depression and anxiety symptoms and an increase in well-being of the participants. Methods: A multi-country, randomized controlled trial will be conducted. The intervention is multicomponent (Cognitive Behavioral Therapy, Behavioral Activation Therapy, Mindfulness, Acceptance and Commitment Therapy, and Positive Psychology), with 10 sessions. In each country, eligible participants will be randomized to one of three groups: Enriched Intervention (interactive web design with videos, infographics, text, audio, and forum), Text Intervention (text on the website), and Wait List (control group). Repeated measures will be obtained at 5-time points. Our primary outcomes will be anxiety symptomatology, depressive symptomatology, and mental well-being. MANOVA analysis will be used for our main analysis. Discussion: This protocol describes the design of a randomized trial to evaluate the efficacy of a web-based intervention to reduce anxiety and depression symptomatology and increase subjective well-being. The intervention will be made available in four languages (Spanish, Portuguese, Dutch, and English). Its results will contribute to the evidence of effectiveness in terms of randomized trials and Internet interventions, mainly in Latin America and Europe. Copyright © 2024 Dominguez-Rodriguez, Herdoiza-Arroyo, González-Ramírez, Martínez-Arriaga, Villarreal-Zegarra, Silva, González-Cantero, Vargas Salinas, Mensorio, Cisneros Hernández, Lourenço dos Santos, Nieto Ramos, Albán-Terán, Mateu-Mollá, Ramírez-Martínez, Colmenero Guadián, Martínez-Rubio, Langer, Araya and Castellanos-Vargas.
Overview
CoChat Summary
TL;DR
This paper is a protocol for a 7-country randomized controlled trial of the free, self-guided “Well-being Online” internet intervention for adults with mild anxiety and/or depressive symptoms. It tests whether an enriched web format outperforms text-only delivery and waitlist control in reducing anxiety and depression and improving well-being.
Key findings
- The trial will be conducted in 7 countries: Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands, and the intervention will be available in 4 languages: Spanish, Portuguese, Dutch, and English.
- Participants will be randomized in a 1:1:1 ratio to Enriched Intervention, Text Intervention, or Waiting List; the intervention includes 10 sessions/modules and repeated assessments at 5 time points for intervention arms.
- The sample-size work targeted detection of a small effect size (0.20) with 0.05 significance and 0.80 power; the authors report that about 160 observations would suffice for the combined group-by-time effect, and they aim for 232 participants after assuming 45% dropout.
- The planned main analyses are MANOVA / mixed model ANOVA with intention-to-treat analysis; missing data will be handled with multiple imputation.
Methods
- Design: Multi-country, parallel, three-arm, superiority randomized controlled trial with two blinding levels (those delivering the intervention and those analyzing data), plus a waitlist control that later receives one of the two intervention arms.
- Sample/data: Adults 18+ living in the participating countries, fluent in the relevant language, and completing the pre-intervention evaluation; exclusion criteria include severe depression, PTSD, suicidal ideation, recent depressive/anxiety diagnosis, current medication for these symptoms, or other specified psychiatric comorbidities.
- Main analysis: Between-subjects MANOVA for group differences in change, plus mixed model ANOVA over country and time; models adjusted for gender and age, with adj partial eta squared as effect size.
Limitations
- The authors explicitly state that the study may be limited by self-selection bias: people more motivated to seek help may be more likely to participate.
- They state the study may have limited generalizability because it may not represent the wider population and may mainly include people comfortable with internet-based interventions.
- They also note possible limitations from measurement scope/sensitivity, lack of personalization, dropout/non-adherence, technical problems, and the absence of direct therapist interaction; additionally, the platform cannot identify users who re-enter after abandoning and switching email accounts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
32 Valid · 1 Not valid · 15 Not checked · 32 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“furthermore previous studies conducted by the team members (Dominguez-Rodriguez et al., 2023; Martínez-Arriaga et al., 2023) have found that participants do answer all the assessments, and this helps to analyze the impact of the intervention.”
§ Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial > Discussion
What the sources say
- Disputedcites Dominguez-Rodriguez et al., 2023 matched to “The Efficacy and Usability of an Unguided Web-Based Grief Intervention for Adults Who Lost a Loved One During the COVID-19 Pandemic: Randomized Controlled Trial” (2023) sourceExperimental — accuracy not yet measured
The Results (comparisons between groups, Table 3; no page available) show incomplete posttest responses: 43 of 45 treatment participants answered several measures. The Results (three-month follow-up, Table 5) include only 18 participants, and the Discussion (Principal Findings) says only intervention completers could access the postmeasurement assessment. These findings contradict the claim that participants answered all assessments. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Partly supportedcites Martínez-Arriaga et al., 2023 matched to “Suicide risk and associated factors in healthcare workers seeking psychological support during COVID-19: a cross-sectional study” (2023) sourceExperimental — accuracy not yet measured
The Participants and procedures section (page unavailable) says participants were given questionnaires before the intervention, and the Results report data from 623 participants. The paper does not establish that participants answered all assessments; it also refers to participants dropping out during the assessment process. The statement about how this helps analyze intervention impact is the citing authors’ inference, not a finding attributed to this source. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“It is estimated that in Mexico, only one in 10 people who need psychological treatment have access to a mental health professional (Flores-Plata et al., 2014).”
§ Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial > Introduction
What the sources say
- Supportedcites Flores-Plata et al., 2014 matched to “Psicoterapia vía Internet: aplicación de un programa de intervención cognitivo-conductual para pacientes con depresión” (2014) source
The Resumen states that in Mexico, only one in ten people who required psychological care accessed a professional. The Abstract repeats this finding in English, matching the cited estimate. (LLM, conf=0.94)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“PSS-10 has good reliability and validity in its versions in English (Denovan et al., 2019), Spanish (González-Ramírez et al., 2013), Brazilian Portuguese (Siqueira Reis et al., 2010), and Dutch (van Eck et al., 1996).”
§ Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial > Methods and analysis > Measures
What the sources say
- Supportedcites Denovan et al., 2019 matched to “Evaluating the perceived stress scale among UK university students: implications for stress measurement and management” (2019) source
Denovan et al. support the English-version portion of the sentence, the part attributed to them. In a UK university student sample, the Reliability analysis reports satisfactory internal consistency for the PSS-10 total factor, and the Convergent validity section reports validity evidence. The other language versions are attributed to other citations, not Denovan et al. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites González-Ramírez et al., 2013 matched to “The perceived stress scale (PSS): normative data and factor structure for a large-scale sample in Mexico” (2013) source
- Not checked — no full text of the sourcecites Siqueira Reis et al., 2010 matched to “Perceived Stress Scale: Reliability and Validity Study in Brazil” (2010) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).”
§ Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial > Methods and analysis > Measures
What the sources say
- Not checked — no full text of the sourcecites Diener et al., 1985 matched to “The satisfaction with life scale” (1985) source
- Supportedcites López-Ortega et al., 2016 matched to “Psychometric properties of the satisfaction with life scale (SWLS): secondary analysis of the Mexican health and aging study” (2016) source
The López-Ortega citation is attached to the Spanish version, not to the English, Brazilian Portuguese, or Dutch versions. The Discussion reports good internal consistency and favourable factor validity in a Mexican sample, and the Conclusions report acceptable criterion validity for the Spanish SWLS. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites Zanon et al., 2014 matched to “Validation of the satisfaction with life scale to Brazilians: evidences of measurement noninvariance across Brazil and US” (2014) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“PSQI has good reliability and validity in its versions in English (Buysse et al., 1991), Spanish (Jiménez-Genchi et al., 2008), Brazilian Portuguese (Bertolazi et al., 2011) and following Zwart et al. (2018), the Dutch version provided by eProvide® will be used.”
§ Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial > Methods and analysis > Measures
What the sources say
- Not checked — no full text of the sourcecites Buysse et al., 1991 matched to “Quantification of subjective sleep quality in healthy elderly men and women using the Pittsburgh sleep quality index (PSQI)” (1991) source
- Not checked — no full text of the sourcecites Jiménez-Genchi et al., 2008
- Supportedcites Bertolazi et al., 2011 matched to “Validation of the Brazilian Portuguese version of the Pittsburgh sleep quality index” (2011) source
Bertolazi et al. support the part of the sentence attributed to them: the Conclusions (section 5) state that the Brazilian Portuguese PSQI is valid and reliable. The Abstract reports a reliability coefficient of 0.82 and significant differences between diagnostic groups and controls. The English and Spanish versions are attributed to other citations in the sentence. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
25 more claims · 14 with their cited sources checked
Create a free account to see all 80 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 38
Citations
Cites
The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research
Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989) · Psychiatry Research · doi:10.1016/0165-1781(89)90047-4 · Cited by 35,234
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807 · cited 1×
“The Perceived Stress Scale (PSS-10) will be applied (Cohen et al., 1983).”
MethodDevelopment and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
The satisfaction with life scale
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4901_13 · Cited by 31,768 · cited 16×
“PSS-10 has good reliability and validity in its versions in English (Denovan et al., 2019”
BackgroundMethodInfluentialA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 16×
“PSS-10 has good reliability and validity in its versions in English (Denovan et al., 2019”
BackgroundMethodInfluentialSUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation
Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., Parkinson, J., Secker, J., & Stewart-Brown, S. (2007) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-5-63 · Cited by 5,031
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950
The effect of mindfulness based therapy on anxiety and depression: A meta analytic review
Hofmann, S. G., Sawyer, A. T., Witt, A. A., & Oh, D. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018555 · Cited by 3,846 · cited 4×
“Several interventions have been shown to be effective in reducing depression and anxiety symptomatology, such as Acceptance and Commitment Therapy (Bai et al., 2020; Gloster et al., 2020), Cognitive Behavioral Therapy (Butler et al., 2006), Mindfulness (Hofmann et al., 2010), Behavioral Activation for Depression (Cuij…”
BackgroundInfluentialCOVID-19 pandemic and mental health consequences: Systematic review of the current evidence
Vindegaard, N., & Benros, M. E. (2020) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2020.05.048 · Cited by 3,221
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
Assessment of client/patient satisfaction: development of a general scale
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., & Nguyen, T. D. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90094-6 · Cited by 2,887 · cited 1×
“The second instrument is the Client Satisfaction Questionnaire (CSQ-8; Larsen et al., 1979).”
MethodValidation of the Brazilian Portuguese version of the Pittsburgh sleep quality index
Bertolazi, A. N., Fagondes, S. C., Hoff, L. S., Dartora, E. G., da Silva Miozzo, I. C., de Barba, M. E. F., & Menna Barreto, S. S. (2011) · Sleep Medicine · doi:10.1016/j.sleep.2010.04.020 · Cited by 1,211 · cited 7×
“SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).”
MethodInfluentialCultural adaptation of treatments: A resource for considering culture in evidence-based practice
Bernal, G., Jiménez-Chafey, M. I., & Domenech Rodríguez, M. M. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0016401 · Cited by 1,186 · cited 1×
“For this purpose, cross-cultural studies are needed because cultural adaptation of psychological interventions is associated with greater effectiveness compared to those that are not culturally adapted (Bernal et al., 2009).”
BackgroundAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 1×
“Individuals can access the intervention from the comfort of their homes, at a time that works best for them, without needing to schedule and attend appointments with a mental health professional (Andersson and Titov, 2014).”
BackgroundBehavioral activation treatments of depression: a meta-analysis.
Cuijpers, P., van Straten, A., & Warmerdam, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.11.001 · Cited by 1,144
BEEKMAN, A. T. F., DEEG, D. J. H., VAN LIMBEEK, J., BRAAM, A. W., DE VRIES, M. Z., & VAN TILBURG, W. (1997) · Psychological Medicine · doi:10.1017/s0033291796003510 · Cited by 1,115 · cited 13×
“SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).”
BackgroundInfluentialSpijkerman, M. P. J., Pots, W. T. M., & Bohlmeijer, E. T. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.009 · Cited by 975
Lamers, F., van Oppen, P., Comijs, H. C., Smit, J. H., Spinhoven, P., van Balkom, A. J. L. M., Nolen, W. A., Zitman, F. G., Beekman, A. T. F., & Penninx, B. W. J. H. (2011) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10m06176blu · Cited by 913
Perceived Stress Scale: Reliability and Validity Study in Brazil
Siqueira Reis, R., Ferreira Hino, A. A., & Romélio Rodriguez Añez, C. (2010) · Journal of Health Psychology · doi:10.1177/1359105309346343 · Cited by 698
Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., Freire, O., & Rejas, J. (2010) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-8-8 · Cited by 673
Development of the Telehealth Usability Questionnaire (TUQ)
Parmanto, B., Lewis, Jr., Graham, K. M., & Bertolet, M. H. (2016) · International Journal of Telerehabilitation · doi:10.5195/ijt.2016.6196 · Cited by 624
The empirical status of acceptance and commitment therapy: A review of meta-analyses
Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., & Karekla, M. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.09.009 · Cited by 622 · cited 1×
“…have been shown to be effective in reducing depression and anxiety symptomatology, such as Acceptance and Commitment Therapy (Bai et al., 2020; Gloster et al., 2020), Cognitive Behavioral Therapy (Butler et al., 2006), Mindfulness (Hofmann et al., 2010), Behavioral Activation for Depression…”
Backgroundvan Eck, M., Berkhof, H., Nicolson, N., & Sulon, J. (1996) · Psychosomatic Medicine · doi:10.1097/00006842-199609000-00007 · Cited by 617
Dropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597
Chakhssi, F., Kraiss, J. T., Sommers-Spijkerman, M., & Bohlmeijer, E. T. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1739-2 · Cited by 352
Acceptance and Commitment Therapy (ACT) to reduce depression: a systematic review and meta-analysis
Bai, Z., Luo, S., Zhang, L., Wu, S., & Chi, I. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.040 · Cited by 321
McAllister-Williams, R. H., Arango, C., Blier, P., Demyttenaere, K., Falkai, P., Gorwood, P., Hopwood, M., Javed, A., Kasper, S., Malhi, G. S., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.02.023 · Cited by 278
Donker, T., van Straten, A., Marks, I., & Cuijpers, P. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.01.016 · Cited by 273
Ruiz, F., Langer Herrera, Á., Luciano, C., Cangas, A., & Beltrán, I. (2013) · Psicothema · doi:10.7334/psicothema2011.239 · Cited by 255
The Satisfaction With Life Scale (SWLS): appraisal with 1700 healthy young adults in The Netherlands
Arrindell, W. A., Heesink, J., & Feij, J. A. (1999) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00180-9 · Cited by 248 · cited 13×
“SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).”
BackgroundInfluentialEngelen, U., Peuter, S. D., Victoir, A., Diest, I. V., & den Bergh, O. V. (2006) · gedrag en gezondheid · doi:10.1007/bf03087979 · Cited by 216
Lean, M., Fornells-Ambrojo, M., Milton, A., Lloyd-Evans, B., Harrison-Stewart, B., Yesufu-Udechuku, A., Kendall, T., & Johnson, S. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.54 · Cited by 211
Moreno, A. L., DeSousa, D. A., Souza, A. M. F. L. P., Manfro, G. G., Salum, G. A., Koller, S. H., Osório, F. L., & Crippa, J. A. S. (2016) · Temas em Psicologia · doi:10.9788/tp2016.1-25 · Cited by 207 · cited 3×
“CESD-R has good reliability and validity in its versions in English (Eaton et al., 2004), Spanish (González-Forteza et al., 2011), Brazilian-Portuguese (Faro et al., 2020), and Dutch (Beekman et al., 1997).”
BackgroundLópez-Ortega, M., Torres-Castro, S., & Rosas-Carrasco, O. (2016) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0573-9 · Cited by 204
Cultural Adaptation of Scalable Psychological Interventions: A New Conceptual Framework
Heim, E., & Kohrt, B. A. (2019) · Clinical Psychology in Europe · doi:10.32872/cpe.v1i4.37679 · Cited by 191
Harper Shehadeh, M., Heim, E., Chowdhary, N., Maercker, A., & Albanese, E. (2016) · JMIR Mental Health · doi:10.2196/mental.5776 · Cited by 188
Spanhel, K., Balci, S., Feldhahn, F., Bengel, J., Baumeister, H., & Sander, L. B. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00498-1 · Cited by 178 · cited 2×
“The participation of the seven countries has led to cultural adaptations in language and materials, following the recommendations of the literature on this topic (Spanhel et al., 2021).”
BackgroundMethodThompson, E. M., Destree, L., Albertella, L., & Fontenelle, L. F. (2021) · Behavior Therapy · doi:10.1016/j.beth.2020.07.002 · Cited by 177 · cited 5×
“Several interventions have been shown to be effective in reducing depression and anxiety symptomatology, such as Acceptance and Commitment Therapy (Bai et al., 2020; Gloster et al., 2020), Cognitive Behavioral Therapy (Butler et al., 2006), Mindfulness (Hofmann et al., 2010), Behavioral Activation for Depression (Cuij…”
BackgroundMethodInfluentialRith-Najarian, L. R., Boustani, M. M., & Chorpita, B. F. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.06.035 · Cited by 176
(1990) · Cited by 172
Denovan, A., Dagnall, N., Dhingra, K., & Grogan, S. (2019) · Studies in Higher Education · doi:10.1080/03075079.2017.1340445 · Cited by 151
Acceptance and Commitment Therapy in group format for anxiety and depression. A systematic review.
Coto-Lesmes, R., Fernández-Rodríguez, C., & González-Fernández, S. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.154 · Cited by 141
Zanon, C., Bardagi, M. P., Layous, K., & Hutz, C. S. (2014) · Social Indicators Research · doi:10.1007/s11205-013-0478-5 · Cited by 140 · cited 6×
“SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).”
BackgroundInfluentialDistress improves after mindfulness training for progressive MS: a pilot randomised trial
Bogosian, A., Chadwick, P., Windgassen, S., Norton, S., McCrone, P., Mosweu, I., Silber, E., & Moss-Morris, R. (2015) · Multiple Sclerosis Journal · doi:10.1177/1352458515576261 · Cited by 135
Online interventions for depression and anxiety – a systematic review
Saddichha, S., Al-Desouki, M., Lamia, A., Linden, I. A., & Krausz, M. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.945934 · Cited by 133 · cited 1×
“Online psychological interventions have emerged as a treatment alternative as they can be accessible, flexible, personalized, and available for large populations (Saddichha et al., 2014; Dominguez-Rodriguez and De La Rosa-Gómez, 2022).”
BackgroundCarvalho, H. W. D., Andreoli, S. B., Lara, D. R., Patrick, C. J., Quintana, M. I., Bressan, R. A., Melo, M. F. D., Mari, J. D. J., & Jorge, M. R. (2013) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2012-0957 · Cited by 126
Mordkoff, J. T. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919855053 · Cited by 122 · cited 1×
“The adjusted partial eta squared (adj η 2) will be used to evaluate the effect size, knowing that the values 0.02 indicate a small effect size, 0.15 medium, and 0.30 large (Mordkoff, 2019).”
MethodInfluentialTaylor, C. B., Graham, A. K., Flatt, R. E., Waldherr, K., & Fitzsimmons-Craft, E. E. (2021) · European Journal of Public Health · doi:10.1093/eurpub/ckz208 · Cited by 114
A cross-national validation of the client satisfaction questionnaire: the Dutch experience
De Brey, H. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90018-6 · Cited by 109 · cited 1×
“This 8-item scale measures the level of satisfaction with the treatment and has been used to evaluate self-administered treatments before and showed a high degree of internal consistency (De Brey, 1983; Roberts and Attkisson, 1983).”
Method(2008) · PubMed · Cited by 107
Internet-based exercise intervention systems: Are more interactive designs better?
Hurling, R., Fairley, B. W., & Dias, M. B. (2006) · Psychology & Health · doi:10.1080/14768320600603257 · Cited by 94
González-Ramírez, M. T., Rodríguez-Ayán, M. N., & Hernández, R. L. (2013) · The Spanish Journal of Psychology · doi:10.1017/sjp.2013.35 · Cited by 91
Chang, E. C., & Chang, O. D. (2016) · Cognitive Therapy and Research · doi:10.1007/s10608-016-9758-0 · Cited by 88 · cited 2×
“Both instruments are described elsewhere (see Weathers et al., 2013 and Chang and Chang, 2016) and show adequate reliability and validity indicators in the countries involved in this study.”
BackgroundMethodLanguage Skills and Labor Market Performance of Immigrants in the Netherlands
Netherlands, T., Yao, Y., & OURS, J. C. V. (2015) · Cited by 87
Jiménez-Molina, Á., Franco, P., Martínez, V., Martínez, P., Rojas, G., & Araya, R. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00664 · Cited by 85
A systematic review and meta-analysis on the efficacy of Internet-delivered behavioral activation
Huguet, A., Miller, A., Kisely, S., Rao, S., Saadat, N., & McGrath, P. J. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.073 · Cited by 85
Cavanagh, K. (2010) · Oxford Guide to Low Intensity CBT Interventions · doi:10.1093/med:psych/9780199590117.003.0021 · Cited by 76 · cited 1×
“Adherence and dropouts are among the most discussed issues related to self-guided interventions (Cavanagh, 2010; Melville et al., 2010).”
BackgroundOrtuño-Sierra, J., Santarén-Rosell, M., de Albéniz, A. P., & Fonseca-Pedrero, E. (2015) · Psychological Assessment · doi:10.1037/pas0000107 · Cited by 76
Assessing client satisfaction among hispanics
Roberts, R. E., & Attkisson, C. C. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90019-8 · Cited by 72 · cited 1×
“This 8-item scale measures the level of satisfaction with the treatment and has been used to evaluate self-administered treatments before and showed a high degree of internal consistency (De Brey, 1983; Roberts and Attkisson, 1983).”
MethodZwart, T. C., Smits, M. G., Egberts, T. C. G., Rademaker, C. M. A., & van Geijlswijk, I. M. (2018) · Healthcare · doi:10.3390/healthcare6010023 · Cited by 65
Fernández, D., Vigo, D., Sampson, N. A., Hwang, I., Aguilar-Gaxiola, S., Al-Hamzawi, A. O., Alonso, J., Andrade, L. H., Bromet, E. J., de Girolamo, G., et al. (2021) · Psychological Medicine · doi:10.1017/s0033291720000884 · Cited by 65
Morgan, C., Mason, E., Newby, J. M., Mahoney, A. E. J., Hobbs, M. J., McAloon, J., & Andrews, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.003 · Cited by 58 · cited 4×
“Several interventions have been shown to be effective in reducing depression and anxiety symptomatology, such as Acceptance and Commitment Therapy (Bai et al., 2020; Gloster et al., 2020), Cognitive Behavioral Therapy (Butler et al., 2006), Mindfulness (Hofmann et al., 2010), Behavioral Activation for Depression (Cuij…”
BackgroundInfluentialGranet, J., Peyrusqué, E., Ruiz, F., Buckinx, F., Abdelkader, L. B., Dang-Vu, T. T., Sirois, M.-J., Gouin, J.-P., Pageaux, B., & Aubertin-Leheudre, M. (2023) · The Journals of Gerontology Series A · doi:10.1093/gerona/glac127 · Cited by 58
Weisel, K. K., Zarski, A.-C., Berger, T., Krieger, T., Schaub, M. P., Moser, C. T., Berking, M., Dey, M., Botella, C., Baños, R., et al. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.04.002 · Cited by 57
Ye, Z., Li, W., & Zhu, R. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.08.023 · Cited by 56 · cited 1×
“Furthermore, meta-analyses have revealed that self-applied internet interventions are effective at reducing both depression and anxiety symptomatology and increasing well-being (Pang et al., 2021; Ye et al., 2022).”
BackgroundMarcelle, E. T., Nolting, L., Hinshaw, S. P., & Aguilera, A. (2019) · JMIR mhealth and uhealth · doi:10.2196/10948 · Cited by 56
Santos, J. J. A. D., Costa, T. A. D., Guilherme, J. H., Silva, W. C. D., Abentroth, L. R. L., Krebs, J. A., & Sotoriva, P. (2015) · Revista da Associação Médica Brasileira · doi:10.1590/1806-9282.61.03.209 · Cited by 55
Diotaiuti, P., Valente, G., Mancone, S., Grambone, A., & Chirico, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.773363 · Cited by 55
Khansa, W., Haddad, C., Hallit, R., Akel, M., Obeid, S., Haddad, G., Soufia, M., Kheir, N., Abi Elias Hallit, C., Khoury, R., et al. (2020) · Perspectives In Psychiatric Care · doi:10.1111/ppc.12423 · Cited by 45
Transdiagnostic factors in symptoms of depression and post-traumatic stress: a systematic review
Hernández-Posadas, A., Lommen, M. J. J., la Rosa-Gómez, A. D., Bouman, T. K., Díaz, J. M. M., & del Palacio‐González, A. (2023) · Current Psychology · doi:10.1007/s12144-023-04792-x · Cited by 44
Hao, X., Jia, Y., Chen, J., Zou, C., & Jiang, C. (2023) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s425509 · Cited by 36
Interventions to Support Integrated Psychological Care and Holistic Health Outcomes in Paediatrics
Shafran, R., Bennett, S. D., & Smith, M. M. (2017) · Healthcare · doi:10.3390/healthcare5030044 · Cited by 35 · cited 1×
“By integrating mindfulness and positive psychology, the intervention addresses negative symptoms and promotes positive emotions and behaviors, so it takes a holistic approach to mental health (Shafran and Bennett, 2017).”
BackgroundNegative effects in internet-based interventions for depression: a qualitative content analysis
Fenski, F., Rozental, A., Heinrich, M., Knaevelsrud, C., Zagorscak, P., & Boettcher, J. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100469 · Cited by 28 · cited 1×
“Monitoring adverse effects is an effective strategy for preventing them and reducing dropout rates in web-based interventions (Fenski et al., 2021).”
BackgroundDominguez-Rodriguez, A., & De La Rosa-Gómez, A. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.866155 · Cited by 28
Moshe, I., Terhorst, Y., Paganini, S., Schlicker, S., Pulkki-Råback, L., Baumeister, H., Sander, L. B., & Ebert, D. D. (2022) · Journal of Medical Internet Research · doi:10.2196/38261 · Cited by 28
Dominguez-Rodriguez, A., Sanz-Gomez, S., González Ramírez, L. P., Herdoiza-Arroyo, P. E., Trevino Garcia, L. E., de la Rosa-Gómez, A., González-Cantero, J. O., Macias-Aguinaga, V., & Miaja, M. (2023) · Journal of Medical Internet Research · doi:10.2196/43839 · Cited by 25
Self-citationAmarnath, A., Ozmen, S., Struijs, S. Y., de Wit, L. M., & Cuijpers, P. J. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100612 · Cited by 25
Propriedades psicométricas iniciais do Acceptance and Action Questionnaire - II - versão brasileira
Barbosa, L. M., & Murta, S. G. (2015) · Psico-USF · doi:10.1590/1413-82712015200107 · Cited by 24
Görges, F., Oehler, C., von Hirschhausen, E., Hegerl, U., & Rummel‐Kluge, C. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.001 · Cited by 23
Pang, Y., Zhang, X., Gao, R., Xu, L., Shen, M., Shi, H., Li, Y., & Li, F. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03396-8 · Cited by 21
Martínez-Arriaga, R. J., Dominguez-Rodriguez, A., Herdoiza-Arroyo, P. E., Robles-Garcia, R., de la Rosa-Gómez, A., Figueroa González, J. A., & Muñoz Anacona, Y. A. (2023) · Psychology, Health & Medicine · doi:10.1080/13548506.2023.2216469 · Cited by 19
Rubel, J. A., Väth, T., Hanraths, S., Pruessner, L., Timm, C., Hartmann, S. F., Barnow, S., & Lalk, C. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100716 · Cited by 19
The say ‘yes’ to life (SYTL) program: A positive psychology group intervention for depression
Carr, A., & Finnegan, L. (2015) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-014-9269-9 · Cited by 18 · cited 1×
“Therefore, it is an evidence-based intervention, as all of these components have shown high effectiveness in treating anxiety and depression previously (Carr and Finnegan, 2015; Bai et al., 2020).”
BackgroundDominguez-Rodriguez, A., Martínez-Luna, S. C., Hernández Jiménez, M. J., De La Rosa-Gómez, A., Arenas-Landgrave, P., Esquivel Santoveña, E. E., Arzola-Sánchez, C., Alvarez Silva, J., Solis Nicolas, A. M., Colmenero Guadián, A. M., et al. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.644782 · Cited by 18
Self-citationAn interdisciplinary multimodal integrative healthcare program for depressive and anxiety disorders
Wijnen, J., Gordon, N. L., Hullenaar, G. V. ’., Pont, M. L., Geijselaers, M. W. H., Oosterwijck, J. V., & de Jong, J. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1113356 · Cited by 18
Sikorski, F., König, H.-H., Wegscheider, K., Zapf, A., Löwe, B., & Kohlmann, S. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100435 · Cited by 15
Flores Plata, L. A., Cárdenas López, G., Durán Baca, X., & De la Rosa Gómez, A. (2014) · Psicología Iberoamericana · doi:10.48102/pi.v22i1.139 · Cited by 14
Kurniawan, K., Yosep, I., Maulana, S., Mulyana, A. M., Amirah, S., Abdurrahman, M. F., Sugianti, A., Putri, E. G., Khoirunnisa, K., Komariah, M., et al. (2022) · Sustainability · doi:10.3390/su141912866 · Cited by 14
Mancone, S., Diotaiuti, P., Valente, G., Corrado, S., Bellizzi, F., Vilarino, G. T., & Andrade, A. (2023) · Behavioral Sciences · doi:10.3390/bs13070550 · Cited by 14
Tur, C., Campos, D., Herrero, R., Mor, S., López-Montoyo, A., Castilla, D., & Quero, S. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-046477 · Cited by 9
Alirahmi, M., Aibod, S., Azizifar, A., & Kikhavani, S. (2023) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1552_22 · Cited by 9
Validación de la Escala de bienestar mental de Wareick-Edinburgo, en Chile
Carvajal (2015) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.31052/1853.1180.v19.n1.11822 · Cited by 9
Faro, A., Nunes dos Santos, D., Eaton, W. W., Department of Psychology, F. U. O. S., Department of Mental Health, B. S. O. P. H., Department of Psychology, F. U. O. S., & Department of Mental Health, B. S. O. P. H. (2021) · Suma Psicológica · doi:10.14349/sumapsi.2021.v28.n1.2 · Cited by 4
Moreno-Peral, P., Rodríguez-Morejón, A., Bellón, J. A., García-Huércano, C., Martínez-Vispo, C., Campos-Paino, H., Galán, S., Reyes-Martín, S., Sánchez Aguadero, N., Rangel-Henriques, M., et al. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100640 · Cited by 4 · cited 1×
“Participants will not be blinded to the intervention they receive, which is frequent among web-based interventions due to the nature of these studies (Sikorski et al., 2021; Moreno-Peral et al., 2023).”
BackgroundTransdiagnostic factors in depression and post-traumatic stress in a Mexican and Dutch sample
Hernández-Posadas, A., la Rosa-Gómez, A. D., Bouman, T. K., Díaz, J. M. M., del Palacio‐González, A., & Lommen, M. J. J. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112476 · Cited by 3
Language skills and labor market performance of immigrants in the Netherlands
Yao, Y., & van Ours, J. C. (2015) · Labour Economics · doi:10.1016/j.labeco.2015.03.005
Research works printed but not linked: 7
- Botella, 2009, Advances in psychological treatments: the use of new information and communication technologies [Avances en los tratamientos psicológicos: la utilización de las nuevas tecnologías de la información y la comunicación], UB J Psychol, 40, 155
- Bretón-López, 2017, Review of applications of information and communication technologies in clinical and health psychology in childhood and adolescence [Revisión de aplicaciones de las tecnologías de la información y la comunicación en psicología clínica y de la salud en infancia y adolescencia], Revista de Psicología Clínica con Niños y Adolescentes, 4, 11
- Eaton, 2004, Center for Epidemiologic Studies Depression Scale: review and revision (CESD and CESD-R), 363
- Eurobarometer, 2006, Europeans and their languages
- González-Forteza, 2011, Reliability and validity of the depression scale CES-D in high school and college students from Mexico City: Results from a census [Confiabilidad y validez de la escala de depresión CES-D en un censo de estudiantes de nivel medio superior y superior, en la Ciudad de México], Salud Mental, 34, 53
- Jacobs, 2008, Measuring experiential avoidance. Dutch translation of the acceptance and action questionnaire-II (AAQ-II), Gedragstherapie, 41, 349
- 2018, The burden of mental disorders in the region of the Americas
Cited by
Méndez, R. M. Y., Méndez, R. M. Y., Villarreal‐Zegarra, D., Villarreal‐Zegarra, D., Sánchez-Broncano, J., Vilela-Estrada, A. L., Vilela-Estrada, A. L., Reátegui-Rivera, C. M., Reátegui-Rivera, C. M., Rojas-Mezarina, L., et al. (2025) · JMIR Formative Research · doi:10.2196/71465 · Cited by 5
Self-citationGonzález-Ramírez, L. P., González-Cantero, J. O., Martínez-Arriaga, R. J., et al. (2026) · medRxiv · doi:10.64898/2026.02.22.26346851
Self-citationDoomscrolling vs. Screen Time: Mental Health Risks for College Students
Rana, E. S., Leviyah, X., Randle, T. S., & Smith, Z. R. (2026) · Journal of College Student Mental Health · doi:10.1080/28367138.2026.2721339
González-Ramírez, L. P., González-Cantero, J. O., Martínez-Arriaga, R. J., Jiménez, S., Herdoiza-Arroyo, P. E., Robles, R., Castellanos-Vargas, R. O., & Rodríguez, A. D. (2026) · PLoS ONE · doi:10.1371/journal.pone.0344411
“The Well-being online intervention targets participants from seven countries: the Netherlands, Spain, Mexico, Peru, Ecuador, Brazil, and Chile [26].”
Self-citation
Metadata
- Authors
- Dominguez-Rodriguez, A., Herdoiza-Arroyo, P. E., González-Ramírez, L. P., Martínez-Arriaga, R. J., Villarreal-Zegarra, D., Santos da Silva, A. C., González-Cantero, J. O., Vargas Salinas, V. S., S. Mensorio, M., Cisneros Hernández, A. A., Lourenço dos Santos, R., Nieto Ramos, E. G., Albán-Terán, M. G., Mateu-Mollá, J., Ramírez-Martínez, F. R., Colmenero Guadián, A. M., Martínez-Rubio, D., Langer, Á. I., Araya, C., & Castellanos-Vargas, R. O.
- Affiliations
- Universidad Internacional del Ecuador (EC)
- Tecnológico de Monterrey (MX)
- Universidad de Guadalajara (MX)
- Valencian International University (ES)
- Universidad Autónoma de Ciudad Juárez (MX)
- ORCID
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2024-05-07
- Volume
- 15
- Pages
- 1279847-1279847
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC11107906
- OpenAlex
- W4396707516
- Cited by
- 3
- References
- 103
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 1.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repositori ObertUDL (University of Lleida) (submittedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Greater South Information System
- Funders
- Instituto Tecnológico y de Estudios Superiores de Monterrey
- Universiteit van Tilburg
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- online intervention, self-administered intervention, anxiety symptoms, depressive symptoms, well-being, cognitive behavioral therapy, behavioral activation, mindfulness, acceptance and commitment therapy, positive psychology, multicomponent intervention, cross-cultural comparison, Latin America, Europe, mental health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

