The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index; 4 of the 56 sources its claims cite were checked for support.
Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial
Open accessAbstract
BACKGROUND: Internet- and mobile based stress-management interventions (iSMI) may be an effective means to address the negative consequences of occupational stress. However, available results from randomised controlled trials are conflicting. Moreover, it is yet not clear whether guided or unguided self-help iSMI provide better value for money. Internet-based mental health interventions without guidance are often much less effective than interventions including at least some guidance from a professional. However, direct comparisons in randomised controlled trials are scarce and, to the best of our knowledge, the comparative (cost)-effectiveness of guided vs. unguided iSMI has not yet been studied. Hence, this study investigates the acceptability and (cost-) effectiveness of minimal guided and unguided iSMI in employees with heightened levels of perceived stress. METHODS: A three-armed randomised controlled trial (RCT) will be conducted to compare a minimal guided and unguided iSMI with a waiting list control condition (WLC). Both active conditions are based on the same iSMI, i.e. GET.ON Stress, and differ only with regard to the guidance format. Employees with heightened levels of perceived stress (PSS ≥ 22) will be randomised to one of three conditions. Primary outcome will be comparative changes in perceived stress (PSS). Secondary outcomes include changes in self-reported depression, work-engagement, presenteeism and absenteeism. Moreover, a cost-effectiveness analysis will be conducted from a societal perspective, including both direct medical costs and costs related to productivity losses. In addition, a cost-benefit analysis will be conducted from the employer's perspective. Incremental net-benefit regression analyses will address the question if there are any baseline factors (i.e. subgroups of employees) associated with particularly favorable cost-effectiveness when the experimental intervention is offered. Assessments take place at baseline, 7 weeks post-treatment and 6 months after randomisation. DISCUSSION: Online-based (guided) self-help interventions could be an acceptable, effective and economically sustainable approach to offer evidence-based intervention alternatives to reduce the negative consequences associated with work-related stress. This study evaluates the (cost-) effectiveness of two versions of an iSMI, minimal guided and unguided iSMI. Thus, the present study will further enhance the evidence-base for iSMI and provide valuable information about the optimal balance between outcome and economic costs. TRIAL REGISTRATION: German Clinical Trial Registration (DRKS): DRKS00005687.
Overview
CoChat Summary
## TL;DR
This paper is a three-armed randomized controlled trial protocol testing whether a minimal-guided and an unguided internet/mobile stress-management program (GET.ON Stress) are more effective and cost-effective than waiting list control in employees with heightened perceived stress. It also aims to compare the two support formats on efficacy, acceptability, and economic outcomes.
## Key findings
- Not stated in the paper.
- The planned primary outcome is perceived stress (PSS) at post-treatment, with assessments at baseline, 7 weeks post-treatment, and 6 months after randomisation.
- The study plans to recruit and randomize 408 participants with PSS ≥ 22; the sample size was chosen to detect a between-group effect size of d = 0.30 with 80% power at alpha = .05 (one-tailed).
- The authors hypothesize that both active conditions will be more effective and cost-effective than waiting list control, and that minimal guided iSMI will outperform unguided iSMI in effectiveness, cost-effectiveness, and acceptability; no results are reported in the paper text provided.
## Methods
- Three-armed randomised controlled trial comparing minimal guided iSMI, unguided iSMI, and waiting list control; all intervention arms also had access to treatment as usual.
- Participants are currently employed adults aged >18 with Perceived Stress Scale (PSS-10) scores ≥ 22, internet access, sufficient German, and informed consent; exclusions include prior psychosis/dissociative symptoms and notable suicidal risk.
- Main analyses planned as intention-to-treat plus per-protocol analyses, using ANOVA, multiple imputation for missing data, effect sizes (Cohen’s d), NNT, and economic analyses including cost-effectiveness, cost-utility, cost-benefit, and incremental net-benefit regression.
## Limitations
- The paper explicitly states it includes no objective stress measurement (e.g., cortisol) and relies only on self-report measures.
- The sample is restricted to employees with PSS ≥ 22, so results are said to generalize only to that subgroup, not to the broader working population.
- The study is powered to detect differences in perceived stress reduction, so the authors state the sample will be too small to draw reliable conclusions about moderating effects between guided and unguided groups; this is a limitation stated in the paper.
- Evident from the text: this is a protocol/background-methods paper, so the paper itself provides no outcome results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 1 Not valid · 19 Not checked · 11 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“(2) anonymity is assured when employees want to avoid stigmatisation or self-disclosure in group settings”
§ Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial > Background
What the sources say
- Partly supportedcites [9] Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ: Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res. 2010, 10: 181-doi:10.1186/1472-6963-10-181 sourceExperimental — accuracy not yet measured
Our copy supports the stigma and group-self-disclosure elements: 'Solutions aimed at potential participants' says offering the CWD courses through the Internet 'may also help to reduce stigma' and that internet-based interventions 'avoid the stigma of going to a therapist' and 'may reach people who are not willing to participate in face-to-face interventions', while 'Organizational solutions' notes the possibility of an individual format 'for people who are not willing to participate in group interventions' (linked to 'Unwillingness to participate', where the group format 'assumes that participants are willing to share their problems with others'). Two parts of the claim are not supported: the paper nowhere asserts that anonymity is 'assured' — it only hedges that Internet delivery 'may' reduce stigma — and its population is the general Dutch adult population with subthreshold depression using regional ambulatory mental-health prevention services, not employees/workplace settings. The employee framing is the citing authors' extension. (LLM, conf=0.80)
- Not checked yetcites [10] Buntrock C, Ebert DD, Lehr D, Cuijpers P, Riper H, Smit F, Berking M: Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: design of a randomised controlled trial. BMC Psychiatry. 2014, 14 (1): 25-doi:10.1186/1471-244X-14-25 source
- Not checked yetcites [11] Andersson G, Titov N: Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014, 13 (1): 4-11. doi:10.1002/wps.20083 source
- Not checked yetcites [12] Ruwaard J, Lange A, Bouwman M, Broeksteeg J, Schrieken B: E-mailed standardized cognitive behavioural treatment of work-related stress: a randomized controlled trial. Cogn Behav Ther. 2007, 36 (3): 179-192. doi:10.1080/16506070701381863 source
- Not checked yetcites [13] Ebert DD, Lehr D, Boß L, Riper H, Cuijpers P, Andersson G, Thiart H, Heber E, Berking M: Efficacy of an Internet-based problem-solving training for teachers: Results of a randomized controlled trial. Scand J Work Environ Health.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Internet-based mental health interventions without guidance are often much less effective than interventions including at least some guidance from a professional [15, 16].”
§ Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial > Background
What the sources say
- Not checked yetcites [15] Richards D, Richardson T: Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012, 32 (4): 329-342. doi:10.1016/j.cpr.2012.02.004 source
- Supportedcites [16] Johansson R, Andersson G: Internet-based psychological treatments for depression. Expert Rev Neurother. 2012, 12 (7): 861-869. quiz 870. doi:10.1586/ern.12.63 source
The section 'How important is guidance in guided ICBT?' concludes that 'there is now a strong support for the claim that guided internet-based psychological treatments are more effective than unguided treatments,' and quantifies the gradient: average effect sizes by degree of human support were d = 0.21 (no contact), 0.44 (contact before only), 0.58 (mainly during) and 0.76 (before, during and after), with Spearman rho = 0.64 (p < 0.01), i.e. any contact already doubles the unguided estimate. 'The overall effect of ICBT for depression' additionally reports a previous meta-analysis in which the effect was significantly moderated by guidance (guided d = 0.61 vs unguided d = 0.25). The one caveat is that this review's own dataset is depression-focused (25 trials, 33 comparisons) and it notes the debate plus cases where unguided programs with pretreatment contact showed medium-to-large effects, which the claim's 'often' accommodates. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Our group recently conducted a randomised controlled trial testing the efficacy and cost-effectiveness of an internet-based SMI in employees with heightened levels of perceived stress [25]. Results are still pending.”
§ Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial > Background
What the sources say
- Not checked yetcites [25] Heber E, Ebert DD, Lehr D, Nobis S, Berking M, Riper H: Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial. BMC Public Health. 2013, 13: 655-doi:10.1186/1471-2458-13-655 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, direct comparisons in randomised controlled trials are scarce.”
§ Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial > Background
What the sources say
- Not checked yetcites Reichler et al. in prep
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the majority of affected individuals remains untreated [8].”
§ Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial > Background
What the sources say
- Not checked yetcites [8] American Psychological Association: Stress in America™: Missing the Health Care Connection. [ https://www.apa.org/news/press/releases/stress/2012/full-report.pdf ]
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 35 claims and to verify the 52 references still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 10
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moderate-to-large improvements versus controls were also found for mental health, sleep, perseverance cognitions, and recovery experience outcomes”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [32]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“These improvements remained stable at 6-month follow-up”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [32]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“A significant large reduction in insomnia severity was again reported for intervention group participants postintervention (d = 1.37) versus waitlist controls”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [32]
Experimental — accuracy not yet measured
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392 · cited 2×
“We will use the Short Form 12 (SF-12) [44] and the (EuroQol EQ-5D) [45] to assess quality of life.”
BackgroundMethodMissing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
The measurement of engagement and burnout: a two sample confirmatory factor analytic approach.
Schaufeli, W. B., Salanova, M., González-romá, V., & Bakker, A. B. (2002) · Journal of Happiness Studies · doi:10.1023/a:1015630930326 · Cited by 10,014 · cited 1×
“The Utrecht Work Engagement Scale (UWES) [42] assesses work engagement defined as a “positive, fulfilling, work-related state of mind that is characterised by vigor, dedication, and absorption” [43].”
Background(1996) · Consulting Psychologists Press eBooks · Cited by 7,863
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
High self-control predicts good adjustment, less pathology, better grades, and interpersonal success
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004) · Journal of Personality · doi:10.1111/j.0022-3506.2004.00263.x · Cited by 6,557
Research works printed but not linked: 4
- American Psychological Association: Stress in America™: Missing the Health Care Connection. [ https://www.apa.org/news/press/releases/stress/2012/full-report.pdf ]
- Beck AT, Steer A, Brown GK: BDI-II: Beck Depression Inventory Manual. 2nd ed. San Antonio, TX: Psychological Corporation; 1996. 1996, San Antonio: Psychological Corporation, 2
- Lehr D, Hillert A, Schmitz E, Cut-off-werten EE Von: Screening depressiver Störungen mittels Allgemeiner Depressions- Skala ( ADS-K ) und State-Trait Depressions Scales ( STDS-T ). 2008, 1-10. doi:10.1026/0012-1924.54.1 · doi:10.1026/0012-1924.54.1
- Schaufeli W, Bakker A: Utrecht Work Engagement Scale: Test Manual. 2003, Utrecht: The Netherlands Departmant of Psychology, Utrecht University
Cited by
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
“Fostering adherence to the content of the intervention is often one major aim of human support in stand-alone IMIs, rather than the delivery of new therapeutic techniques that go beyond the content of the current lesson (Ebert et al., 2014; Schueller, Tomasino, & Mohr, 2016; Zarski et al., 2016).”
BackgroundSelf-citationHeber, E., Ebert, D. D., Lehr, D., Cuijpers, P., Berking, M., Nobis, S., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5774 · Cited by 408
“More research on the relative level and type of human involvement needed in these interventions would be useful [64].”
Self-citationInterventions to improve return to work in depressed people
Nieuwenhuijsen, K., Faber, B., Verbeek, J. H., Neumeyer-Gromen, A., Hees, H. L., Verhoeven, A. C., van der Feltz-Cornelis, C. M., & Bültmann, U. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006237.pub3 · Cited by 299
Ebert, D. D., Cuijpers, P., Muñoz, R. F., & Baumeister, H. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00116 · Cited by 244
“However, unguided IMIs might still produce larger effects at population level with regard to the reduction of disease burden, as more individuals could be reached at a given budget (85).”
BackgroundSelf-citationHennemann, S., Beutel, M. E., & Zwerenz, R. (2017) · Journal of Health Communication · doi:10.1080/10810730.2017.1284286 · Cited by 274
Metadata
- Authors
- Ebert, D. D., Lehr, D., Smit, F., Zarski, A.-C., Riper, H., Heber, E., Cuijpers, P., & Berking, M.
- Affiliations
- Leuphana University of Lüneburg (DE)
- Trimbos Institute (NL)
- Corresponding author
- Ebert, David Daniel
- ORCID
- Venue
- BMC Public Health
- Published
- 2014-08-07
- Volume
- 14
- Issue
- 1
- Pages
- 807-807
- ISSN
- 1471-2458 (ISSN-L)
- PMC
- PMC4153891
- OpenAlex
- W2088366764
- Cited by
- 82
- References
- 77
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2023: 4 · 2022: 9 · 2021: 8 · 2020: 6 · 2019: 7 · 2018: 11 · 2017: 11 · 2016: 9 · 2015: 5 · 2014: 5
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Public Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- Multilingual Matters (Channel View Publications) (publishedVersion, cc-by)
- OPUS FAU (Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV), on behalf of the Universitätsbibliothek Erlangen-Nürnberg) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- VU Research Portal (submittedVersion, other-oa)
- Funders
- European Commission (2007DE161PR001, ZW6‐80119999, CCI 2007DE161PR001, EFRE: ZW6-80119999, CCI 2007DE161PR001)
- European Regional Development Fund (ZW6-80119999, CCI 2007DE161PR001, 2007DE161PR001)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Workplace Health and Well-being
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- occupational stress, cost-effectiveness, perceived stress, workers, work engagement, presenteeism, absenteeism, depression, productivity loss, employer perceptions
- MeSH terms
- Absenteeism, Adult, Cost-Benefit Analysis, Depressive Disorder, Female, Follow-Up Studies, Humans, Occupational Diseases, Occupational Health Services, Psychotherapy, Stress, Psychological, Comorbidity, Treatment Outcome, Health Care Costs, Telemedicine, Efficiency, Organizational, Internet, Evidence-Based Practice, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. https://app.cochat.ai/papers/10.1186/1471-2458-14-807
- The paper
- Ebert, D. D., Lehr, D., Smit, F., Zarski, A.-C., Riper, H., Heber, E., Cuijpers, P., & Berking, M. (2014). Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. https://doi.org/10.1186/1471-2458-14-807
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
