Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Background: Work-related stress is associated with a variety of mental and emotional problems and can lead to substantial economic costs due to lost productivity, absenteeism or the inability to work. There is a considerable amount of evidence on the effectiveness of traditional face-to-face stress-management interventions for employees; however, they are often costly, time-consuming, and characterized by a high access threshold. Web-based interventions may overcome some of these problems yet the evidence in this field is scarce. This paper describes the protocol for a study that will examine the efficacy and cost-effectiveness of a web-based guided stress-management training which is based on problem solving and emotion regulation and aimed at reducing stress in adult employees. Methods: The study will target stressed employees aged 18 and older. A randomized controlled trial (RCT) design will be applied. Based on a power calculation of d=.35 (1-β of 80%, α = .05), 264 participants will be recruited and randomly assigned to either the intervention group or a six-month waitlist control group. Inclusion criteria include an elevated stress level (Cohen’s Perceived Stress Scale-10 ≥ 22) and current employment. Exclusion criteria include risk of suicide or previously diagnosed psychosis or dissociative symptoms. The primary outcome will be perceived stress, and secondary outcomes include depression and anxiety. Data will be collected at baseline and seven weeks and six months after randomization. An extended follow up at 12 months is planned for the intervention group. Moreover, a cost-effectiveness analysis will be conducted from a societal perspective and will include both direct and indirect health care costs. Data will be analyzed on an intention-to-treat basis and per protocol. Discussion: The substantial negative consequences of work-related stress emphasize the necessity for effective stress-management trainings. If the proposed internet intervention proves to be (cost-) effective, a preventative, economical stress-management tool will be conceivable. The strengths and limitations of the present study are discussed. Trial registration: German Register of Clinical Studies (DRKS): DRKS00004749
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign
Karasek, R. A. (1979) · Administrative Science Quarterly · doi:10.2307/2392498 · Cited by 12,597
Validation of the Insomnia Severity Index as an outcome measure for insomnia research
Bastien, C. (2001) · Sleep Medicine · doi:10.1016/s1389-9457(00)00065-4 · Cited by 8,067 · cited 1×
“Insomnia severity will be measured with the Insomnia Severity Index (ISI) [63,64].”
MethodJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Development and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099 · cited 1×
“We will use the ultra-brief three-item version of the Penn State Worry Questionnaire (PSWQ) [67,68] to assess worrying.”
MethodMorin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011) · Sleep · doi:10.1093/sleep/34.5.601 · Cited by 4,620
Sonnentag, S., & Fritz, C. (2007) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.12.3.204 · Cited by 2,133
The client satisfaction questionnaire
Attkisson, C. C., & Zwick, R. (1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90074-x · Cited by 1,743 · cited 1×
“), the Effort Reward Imbalance Questionnaire – Short Form (ERI-SF) [75], the hope of improvement subscale of the German Patient Questionnaire on Therapy Expectation and Evaluation (PATHEV) [76] (adapted to the online training context), the German version of the Client Satisfactory Questionnaire (CSQ-8) [77,78] (adapte…”
MethodInternet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 2×
“Furthermore, web-based guided self-help interventions have shown moderate to large effect sizes in numerous studies of, for example, depression and anxiety [12].”
BackgroundMethodSelf-citationEffects of occupational stress management intervention programs: A meta-analysis.
Richardson, K. M., & Rothstein, H. R. (2008) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.13.1.69 · Cited by 1,374 · cited 3×
“” [9] A variety of effective traditional occupational stressmanagement trainings are available [10,11].”
BackgroundCOHEN, S., & JANICKI‐DEVERTS, D. (2012) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2012.00900.x · Cited by 1,187
Research works printed but not linked: 56
- Backé E, Seidler A, Latza U, Rossnagel K, Schumann B: The role of psychosocial stress at work for the development of cardiovascular diseases: a systematic review. Int Arch Occup Environ Health. 2012, 85: 67-79. 10.1007/s00420-011-0643-6. · DOI · Paper page
- Kivimäki M, Virtanen M, Elovainio M, Kouvonen A, Väänänen A, Vahtera J: Work stress in the etiology of coronary heart disease–a meta-analysis. Scand J Work Environ Health. 2006, 32: 431-442. 10.5271/sjweh.1049. · DOI · Paper page
- Stansfeld S, Candy B: Psychosocial work environment and mental health–a meta-analytic review. Scand J Work Environ Health. 2006, 32: 443-462. 10.5271/sjweh.1050. · DOI · Paper page
- Paoli P, Merllié D: Third European survey on working conditions 2000. 2001, Luxembourg: Office for Official Publications of the European Communities
- Akerstedt T: Psychosocial stress and impaired sleep. Scand J Work Environ Health. 2006, 32: 493-501. 10.5271/sjweh.1054. · DOI · Paper page
- Moreau M: Occupational stress and incidence of sick leave in the Belgian workforce: the Belstress study. J Epidemiol Community Health. 2004, 58: 507-516. 10.1136/jech.2003.007518. · DOI
- Ahola K, Toppinen-Tanner S, Huuhtanen P, Koskinen A, Väänänen A: Occupational burnout and chronic work disability: An eight-year cohort study on pensioning among Finnish forest industry workers. J Affect Disord. 2009, 115: 150-159. 10.1016/j.jad.2008.09.021. · DOI
- Rosch PJ: The quandary of job stress compensation. Health and Stress. 2001, 3: 1-4.
- Drozd F, Raeder S, Kraft P, Bjørkli CA: Multilevel growth curve analyses of treatment effects of a web-based intervention for stress reduction: Randomized controlled trial. J Med Internet Res. 2013, 15: e84-10.2196/jmir.2570. · DOI · Paper page
- Wiegand B, Luedtke K, Friscia D, Nair M, Aleles M, McCloskey R: Efficacy of a comprehensive program for reducing stress in women: A prospective, randomized trial. Curr Med Res Opin. 2010, 26: 991-1002. 10.1185/03007991003688193. · DOI · Paper page
- Wade SL, Carey J, Wolfe CR: An online family intervention to reduce parental distress following pediatric brain injury. J Consult Clin Psychol. 2006, 74: 445-454. · DOI · Paper page
- Hänggi Y: Kann web-basierte Stressprävention erfolgreich sein? [Can web-based parental training on coping with familiy stress be successful?]. Z Klin Psychol Psychother. 2006, 35: 169-177. 10.1026/1616-3443.35.3.169. · DOI · Paper page
- Lange A, van de Ven J, Schrieken B, Smit M: 'Interapy' Burn-out: Prävention und Behandlung von Burn-out über das Internet [‘Interapy’ burnout: prevention and therapy of burnout via the internet]. Verhaltenstherapie. 2004, 14: 190-199. 10.1159/000080915. · DOI · Paper page
- Abbott J, Klein B, Hamilton C, Rosenthal AJ: The impact of online resilience training for sales managers on wellbeing and performance. E-JAP. 2009, 5: 89-95.
- Hamberg-van Reenen HH, Proper KI, van den Berg M: Worksite mental health interventions: a systematic review of economic evaluations. Occup Environ Med. 2012, 69: 837-845. 10.1136/oemed-2012-100668. · DOI · Paper page
- Gärtner FR, Ketelaar SM, Smeets O, Bolier L, Fischer E, van Dijk FJH, Nieuwenhuijsen K, Sluiter JK: The Mental Vitality @ Work study: Design of a randomized controlled trial on the effect of a workers' health surveillance mental module for nurses and allied health professionals. BMC Public Health. 2011, 11: 290-10.1186/1471-2458-11-290. · DOI · Paper page
- Geraedts AS, Kleiboer AM, Wiezer NM, van Mechelen W, Cuijpers P: Web-based guided self-help for employees with depressive symptoms (Happy@Work): Design of a randomized controlled trial. BMC Psychiatry. 2013, 13: 61-10.1186/1471-244X-13-61. · DOI · Paper page
- Siegrist J: Reciprocity in basic social exchange and health: Can we reconcile person-based with population-based psychosomatic research?. J Psychosom Res. 1998, 45: 99-105. · doi:10.1016/s0022-3999(98)00019-1
- Lazarus RS, Folkman S: Stress, appraisal, and coping. 1984, New York: Springer
- van Vliet H, Andrews G: Internet-based course for the management of stress for junior high schools. Aust NZ J Psychiatry. 2009, 43: 305-309. 10.1080/00048670902721145. · DOI · Paper page
- Cisler JM, Olatunji BO: Emotion regulation and anxiety disorders. Curr Psychiatry Rep. 2012, 14: 182-187. 10.1007/s11920-012-0262-2. · DOI · Paper page
- Lesage F, Berjot S, Deschamps F: Psychometric properties of the French versions of the Perceived Stress Scale. Int J Occup Med Environ Health. 2012, 25: 178-184. 10.2478/S13382-012-0024-8. · DOI · Paper page
- D'Zurilla T, Nezu A: Problem-Solving Therapy. In Handbook of cognitive-behavioral therapies. 3rd edition. Edited by Dobson KS. 2010, New York: Guilford Press
- Donker T, van Straten A, Riper H, Marks I, Andersson G, Cuijpers P: The design of a randomized controlled trial. Trials. 2009, 10: 59-
- Berking M: Training emotionaler Kompetenzen. 2010, Berlin, Heidelberg: Springer-Verlag Berlin Heidelberg, 2 · DOI
- Berking M, Meier C, Wupperman P: Enhancing emotion-regulation skills in police officers: Results of a pilot controlled study. Behav Ther. 2010, 41: 329-339. 10.1016/j.beth.2009.08.001. · DOI · Paper page
- Cohen S, Kamarck T, Mermelstein R: A global measure of perceived stress. J Health Soc Behav. 1983, 24: 385-396. 10.2307/2136404. · DOI · Paper page
- Michalsen A, Jeitler M, Brunnhuber S, Lüdtke R, Büssing A, Musial F, Dobos G, Kessler C: Iyengar Yoga for distressed women: A 3-armed randomized controlled trial. Evid Based Complement Alternat Med. 2012, 2012: 1-9. · DOI · Paper page
- Radloff LS: The CES-D Scale: A self-report depression scale for research in the general population. Appl Psych Meas. 1977, 1: 385-401. 10.1177/014662167700100306. · DOI · Paper page
- Hautzinger M, Bailer M: (Eds): Allgemeine Depressions Skala. 1993, Manual. Göttingen: Beltz Test GmbH,
- Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983, 67: 361-370. 10.1111/j.1600-0447.1983.tb09716.x. · DOI · Paper page
- Büssing A, Glaser J: Managerial stress und burnout. A collaborative international study (CISMS). Die deutsche Untersuchung (Bericht Nr. 44). 1998, München: Technische Universität, Lehrstuhl für Psychologie
- Schaufeli W, Leiter M, Maslach C, Jackson SE: Maslach Burnout Inventory - General Survey (MBI-GS). In Maslach Burnout Inventory Manual. Edited by Maslach C, Jackson SE, Leiter MP. 1996, Palo Alto, CA: Consulting Psychologists Press
- Neubach B, Schmidt K: Gütekriterien einer deutschen Fassung des Maslach Burnout Inventory (MBI-D) - Eine Replikationsstudie bei Altenpflegekräften [Psychometric properties and validity of a German version of the Maslach Burnout Inventory (MBI—D): A replication study among professionals caring for the elderly]. Z Arb Organ. 2000, 44: 140-156.
- Berking M, Znoj H: Entwicklung und Validierung eines Fragebogens zur standardisierten Selbsteinschätzung emotionaler Kompetenzen (SEK-27) [Development and validation of a self-report instrument for the assessment of emotion-specific regulation skills (ERSQ-27)]. Z Psychiatr Psychol Psychother. 2008, 56: 141-153.
- Ebert D, Christ O, Berking M: Entwicklung und Validierung eines Fragebogens zur emotionsspezifischen Selbsteinschätzung emotionaler Kompetenzen (SEK-ES) [Development and validation of a self-report instrument for the assessment of emotion-specific regulation skills (ERSQ-ES)]. Diagnostica. 2013, 59: 17-32. 10.1026/0012-1924/a000079. · DOI · Paper page
- Fischer EH, Farina A: Attitudes toward seeking professional psychological help: a shortened form and considerations for research. J Coll Student Dev. 1995, 36: 368-373.
- Schaufeli W: Bakker A (Eds): UWES - Utrecht Work Engagement Scale: Test Manual. 2003, Utrecht, The Netherlands: Department of Psychology, Utrecht University,
- Schaufeli W, Salanova M, González-Romá V, Bakker AB: The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. J Happiness Stud. 2002, 3: 71-92. 10.1023/A:1015630930326. · DOI · Paper page
- Morin CM: Insomnia: Psychological assessment and management. 1993, New York: Guilford Press
- Stöber J: PSWQ-PW: Penn State Worry Questionnaire-Past Week. Diagnostische Verfahren in der Psychotherapie [Assessment procedures in psychotherapy. Edited by: Brähler E, Schumacher J, Strauß B. 2002, Göttingen, Germany: Hogrefe, 291-294.
- Ware J, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003. · DOI · Paper page
- Group EQ: EuroQol - a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy. 1990, 16: 199-208. · DOI · Paper page
- Krauth C: Methoden der Kostenbestimmung in der gesundheitsökonomischen Evaluation [Cost estimation methods in health economic evaluation]. Gesundheitsökonomie & Qualitätsmanagement. 2010, 15: 251-259. · DOI
- Hakkaart-van Roijen L: Manual Trimbos/iMTA Questionnaire for costs associated with psychiatric illness (in Dutch). 2002, Rotterdam: Institute for Medical Technology Assessment
- Siegrist J, Wege N, Pühlhofer F, Wahrendorf M: A short generic measure of work stress in the era of globalization: effort–reward imbalance. Int Arch Occup Environ Health. 2009, 82: 1005-1013. 10.1007/s00420-008-0384-3. · DOI · Paper page
- Schulte D: Messung der Therapieerwartung und Therapieevaluation von Patienten (PATHEV) [Measurement of patient's therapy expectancy and therapy evaluation]. Z Klin Psychol Psychother. 2005, 34: 176-187. 10.1026/1616-3443.34.3.176. · DOI · Paper page
- Schmidt J, Lamprecht F, Wittmann WW: Zufriedenheit mit der stationären Versorgung. Entwicklung eines Fragebogens und erste Validitätsuntersuchungen [Satisfaction with inpatient management. Development of a questionnaire and initial validity studies]. Psychother Psychosom Med Psychol. 1989, 39: 248-255.
- Altman DG: Better reporting of randomised controlled trials: the CONSORT statement. BMJ. 1996, 313: 570-571. 10.1136/bmj.313.7057.570. · DOI · Paper page
- Eysenbach G: CONSORT-EHEALTH: Improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011, 13: e126-10.2196/jmir.1923. · DOI · Paper page
- Little RJA, Rubin DB: Statistical analysis with missing data. Wiley series in probability and statistics. Edited by: Hoboken NJ. 2002, : Wiley, 2
- Schafer JL: Analysis of incomplete multivariate data. 2000, Boca Raton: Chapman & Hall/CRC, [Monographs on statistics and applied probability, vol. 72], 1
- Ciarrochi J, Scott G: The link between emotional competence and well-being: a longitudinal study. Brit J Guid Couns. 2006, 34: 231-243. 10.1080/03069880600583287. · DOI · Paper page
- Sonnentag S, Binnewies C, Mojza EJ: Staying well and engaged when demands are high: The role of psychological detachment. J Appl Psychol. 2010, 95: 965-976. · DOI · Paper page
- Berset M, Elfering A, Lüthy S, Lüthi S, Semmer NK: Work stressors and impaired sleep: rumination as a mediator. Stress and Health. 2011, 27: e71-e82. 10.1002/smi.1337. · DOI · Paper page
- Semmer NK, Grebner S, Elfering A: Beyond self-report: Using observational, physiological, and situation-based measures in research on occupational stress. Research in Occupational Stress and Well-being. 2003, Bingley: Emerald (MCB UP), 205-263.
Cited by
Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions
Boß, L., Lehr, D., Reis, D., Vis, C., Riper, H., Berking, M., & Ebert, D. D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5952 · Cited by 251
“The second trial was conducted to evaluate a Web-based stress management intervention in employees (Trial Registration: German Clinical Trial Registry DRKS00004749) [42,43].”
BackgroundSelf-citationWeb-Based and Mobile Stress Management Intervention for Employees: A Randomized Controlled Trial
Heber, E., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5112 · Cited by 213
“A more detailed description of the iSMI can be found in the protocol of the trial [35].”
Self-citationEbert, D. D., Heber, E., Berking, M., Riper, H., Cuijpers, P., Funk, B., & Lehr, D. (2016) · Occupational and Environmental Medicine · doi:10.1136/oemed-2015-103269 · Cited by 176
Self-citationThiart, H., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2015) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3478 · Cited by 168
“But less is known regarding their effectiveness in occupational settings among stressed employees (28).”
BackgroundSelf-citationEbert, D. D., Lehr, D., Boß, L., Riper, H., Cuijpers, P., Andersson, G., Thiart, H., Heber, E., & Berking, M. (2014) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3449 · Cited by 115
“Because deficits in the ability to adaptively cope with difficult emotions are related to various mental health problems (64), the use of effective emotion-regulation techniques (65) in low-threshold internet-based stressmanagement training appears promising (66, 67).”
Self-citation
Metadata
- Authors
- Heber, E., Ebert, D. D., Lehr, D., Nobis, S., Berking, M., & Riper, H.
- Venue
- BMC Public Health
- Published
- 2013-07-15
- Volume
- 13
- Issue
- 1
- Pages
- 655-655
- ISSN
- 1471-2458 (ISSN-L)
- OpenAlex
- W2068965283
- Cited by
- 91
- References
- 36
- FWCI
- 10.45
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/2.0 (tdm)
- creativecommons.org/licenses/by/2.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial. https://app.cochat.ai/papers/10.1186/1471-2458-13-655
- The paper
- Heber, E., Ebert, D. D., Lehr, D., Nobis, S., Berking, M., & Riper, H. (2013). Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial. BMC Public Health. https://doi.org/10.1186/1471-2458-13-655
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.