Effect of an E-mental Health Approach to Workers' Health Surveillance versus Control Group on Work Functioning of Hospital Employees: A Cluster-RCT
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To evaluate an e-mental health (EMH) approach to workers' health surveillance (WHS) targeting work functioning (WF) and mental health (MH) of healthcare professionals in a randomised controlled trial. METHODS: Nurses and allied health professionals (N = 1140) were cluster-randomised at ward level to the intervention (IG) or control group (CG). The intervention consisted of two parts: (a) online screening and personalised feedback on impaired WF and MH, followed by (b) a tailored offer of self-help EMH interventions. CG received none of these parts. Primary outcome was impaired WF (Nurses Work Functioning Questionnaire), assessed at baseline and after three and six months. Analyses were performed in the positively screened subgroup (i) and in all participants (ii). RESULTS: Participation rate at baseline was 32% (NIG = 178; NCG = 188). Eighty-two percent screened positive for at least mild impairments in WF and/or MH (NIG = 139; NCG = 161). All IG-participants (N = 178) received part (a) of the intervention, nine participants (all positively screened, 6%) followed an EMH intervention to at least some extent. Regarding the subgroup of positively screened participants (i), both IG and CG improved over time regarding WF (non-significant between-group difference). After six months, 36% of positively screened IG-participants (18/50) had a relevant WF improvement compared to baseline, versus 28% (32/115) of positively screened CG-participants (non-significant difference). In the complete sample (ii), IG and CG improved over time but IG further improved between three and six months while CG did not (significant interaction effect). CONCLUSIONS: In our study with a full compliance rate of 6% and substantial drop-out leading to a small and underpowered sample, we could not demonstrate that an EMH-approach to WHS is more effective to improve WF and MH than a control group. The effect found in the complete sample of participants is not easily interpreted. Reported results may be useful for future meta-analytic work. TRIAL REGISTRATION: Dutch Trial Register NTR2786.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most interventions (18/28, 64%) were focused on reducing stress [21-35] and depressive symptoms [23,31,36-39] in employees.”
From Acceptability of Web-Based Mental Health Interventions in the Workplace: Systematic Review (2022) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There were also no differences between these two groups at follow-up on scores of mental distress, impaired work functioning or impaired mental health”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Both the intervention and control groups improved in work functioning although there was no significant difference between the two”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Impact of Event Scale: A Measure of Subjective Stress
Horowitz, M., Wilner, N., & Alvarez, W. (1979) · Psychosomatic Medicine · doi:10.1097/00006842-197905000-00004 · Cited by 7,813 · cited 4×
“42 [ 52 ] Panic disorder Patient Health Questionnaire [ 53 ] , only assessed for participants identified as having anxiety complaints 2 answers affirmative on the first 4 items plus 4 symptoms affirmative on the following 11 items [ 54 ] Posttraumatic stress Dutch translation of the Impact of Event Scale [ 37 , 38 ] T…”
MethodInfluentialBush, K. (1998) · Archives of Internal Medicine · doi:10.1001/archinte.158.16.1789 · Cited by 6,196
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557 · cited 1×
“The design, conduct and reporting of this study adhere to the Consolidated Standards of Reporting Trials guidelines [21,22].”
MethodA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Moreover, it could be useful to apply elements of persuasive design to encourage employees to follow an EMH intervention [47,48].”
BackgroundCONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“Moreover, it could be useful to apply elements of persuasive design to encourage employees to follow an EMH intervention [47,48].”
Background
Research works printed but not linked: 3
- B Terluin, 1998, De Vierdimensionele Klachtenlijst (4DKL) in de huisartspraktijk [The Four Dimensional Symptom Questionnaire (4DSQ)], De Psycholoog, 33, 18
- D Brom, 1985, De Schok Verwerkings Lijst [The Impact of Event Scale], Nederlands Tijdschrift voor de Psychologie, 40, 164
- E de Beurs, 2006, De Brief Symptom Inventory (BSI): De betrouwbaarheid en validiteit van een handzaam alternatief voor de SCL-90. [The Brief Symptom Inventory (BSI): The reliability and validity of a brief alternative of the SCL-90], Maandblad Geestelijke Volksgezondheid, 61, 120
Cited by
Preventing occupational stress in healthcare workers
Ruotsalainen, J. H., Verbeek, J. H., Mariné, A., & Serra, C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub5 · Cited by 563
Preventing occupational stress in healthcare workers
Marine, A., Ruotsalainen, J. H., Serra, C., & Verbeek, J. H. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub2 · Cited by 499
Preventing occupational stress in healthcare workers
Ruotsalainen, J. H., Verbeek, J. H., Mariné, A., & Serra, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub3 · Cited by 219
Kawakami, N., & Tsutsumi, A. (2016) · Journal of Occupational Health · doi:10.1539/joh.15-0001-er · Cited by 147
Phillips, E. A., Gordeev, V. S., & Schreyögg, J. (2019) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3839 · Cited by 148
“Aikens et al, 2014 (82) + - + + Imamura et al, 2016 (65) + - + - + Allexandre et al, 2016 (84) + - - + Jonas et al, 2017 (83) + - + - + Billings et al, 2008 (61) ? - + Ketelaar et al, 2013 (85) + - - - ?”
Metadata
- Authors
- Ketelaar, S. M., Nieuwenhuijsen, K., Gärtner, F. R., Bolier, L., Smeets, O., & Sluiter, J. K.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- Trimbos Institute (NL)
- Corresponding author
- Ketelaar, Sarah M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-09-12
- Volume
- 8
- Issue
- 9
- Pages
- e72546
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3772000
- OpenAlex
- W2058569876
- Cited by
- 38
- References
- 48
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 2 · 2023: 1 · 2022: 7 · 2020: 3 · 2019: 3 · 2018: 1 · 2017: 4 · 2016: 3 · 2015: 2 · 2014: 5
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- ZonMw (208010001)
- Trimbos-instituut
- Instituut Gak
- Biotechnology and Biological Sciences Research Council
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Workplace Health and Well-being
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Occupational Health and Burnout
- Keywords
- e-mental health, occupational health surveillance, work functioning, mental health, healthcare workers, nurses, allied health professionals, online screening, personalized feedback, self-help intervention, occupational health, hospital staff
- MeSH terms
- Adult, Female, Humans, Male, Mental Health, Middle Aged, Nurses, Patient Compliance, Population Surveillance, Surveys and Questionnaires, Treatment Outcome, Control Groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effect of an E-mental Health Approach to Workers' Health Surveillance versus Control Group on Work Functioning of Hospital Employees: A Cluster-RCT. https://app.cochat.ai/papers/10.1371/journal.pone.0072546
- The paper
- Ketelaar, S. M., Nieuwenhuijsen, K., Gärtner, F. R., Bolier, L., Smeets, O., & Sluiter, J. K. (2013). Effect of an E-mental Health Approach to Workers' Health Surveillance versus Control Group on Work Functioning of Hospital Employees: A Cluster-RCT. PLoS ONE. https://doi.org/10.1371/journal.pone.0072546
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
