The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index; 7 of the 24 sources its claims cite were checked for support.
Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study
Open accessAbstract
OBJECTIVES: To investigate the feasibility of recruitment, adherence and likely effectiveness of an e-learning intervention for managers to improve employees' well-being and reduce sickness absence. METHODS: The GEM Study (guided e-learning for managers) was a mixed methods pilot cluster randomised trial. Employees were recruited from four mental health services prior to randomising three services to the intervention and one to no-intervention control. Intervention managers received a facilitated e-learning programme on work-related stress. Main outcomes were Warwick Edinburgh Mental Wellbeing Scale (WEMWBS), 12-item GHQ and sickness absence <21 days from human resources. 35 in-depth interviews were undertaken with key informants, managers and employees, and additional observational data collected. RESULTS: 424 of 649 (65%) employees approached consented, of whom 350 provided WEMWBS at baseline and 284 at follow-up; 41 managers out of 49 were recruited from the three intervention clusters and 21 adhered to the intervention. WEMWBS scores fell from 50.4-49.0 in the control (n=59) and 51.0-49.9 in the intervention (n=225), giving an intervention effect of 0.5 (95% CI -3.2 to 4.2). 120/225 intervention employees had a manager who was adherent to the intervention. HR data on sickness absence (n=393) showed no evidence of effect. There were no effects on GHQ score or work characteristics. Online quiz knowledge scores increased across the study in adherent managers. Qualitative data provided a rich picture of the context within which the intervention took place and managers' and employees' experiences of it. CONCLUSIONS: A small benefit from the intervention on well-being was explained by the mixed methods approach, implicating a low intervention uptake by managers and suggesting that education alone may be insufficient. A full trial of the guided e-learning intervention and economic evaluation is feasible. Future research should include more active encouragement of manager motivation, reflection and behaviour change. TRIAL REGISTRATION NUMBER: ISRCTN58661009.
Overview
CoChat Summary
## TL;DR
This pilot cluster randomised trial tested a guided e-learning intervention for managers in four NHS mental health services to improve employee well-being and reduce sickness absence. The study found recruitment and data collection were feasible, but manager uptake was low and the intervention showed only a very small effect on well-being and no clear effect on sickness absence.
## Key findings
- Employees: 424/649 (65%, 95% CI 62% to 69%) consented; 350 completed baseline WEMWBS and 284 provided follow-up WEMWBS.
- Managers: 41/49 were recruited in the intervention clusters, but only 21/41 (51%) met the adherence criterion of completing at least 3 of the 6 main e-learning modules.
- Primary outcome: WEMWBS fell from 50.4 to 49.0 in control and from 51.0 to 49.9 in intervention, with an adjusted intervention effect of 0.5 (95% CI −3.2 to 4.2).
- Sickness absence: HR data were available for 393 employees, and the paper reports no evidence of effect; the self-reported sickness absence effect was 0.1 (95% CI −2.2 to 2.4).
## Methods
- Mixed methods pilot cluster randomised trial in one NHS Mental Health Trust; four workplace services were included, with three services randomised to intervention and one to control.
- Employees were recruited before randomisation; managers in intervention clusters received the Anderson Peak Performance e-learning package “Managing Employee Pressure at Work,” plus facilitator-supported face-to-face, telephone, and email guidance.
- Main quantitative analyses used Stata V.12, were mainly descriptive, and estimated intervention effects with random effects models; qualitative data came from 35 in-depth interviews plus observational data and free-text comments.
## Limitations
- The paper states that the study was not powered to examine effectiveness definitively, and that the short interval between intervention and follow-up may have been too short for managers to implement changes.
- The NHS Trust underwent major reorganisation during the study, which the paper says may have affected acceptance, retention, and intervention uptake.
- The qualitative sample was limited: it included only one “non-adherent” manager, and the authors could not interview managers who did not participate in the study; this is explicitly stated in the paper.
- Evident from the text: only four clusters were included, which makes effect estimates and subgroup analyses very imprecise, with wide confidence intervals.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
4 Valid · 1 Not valid · 14 Not checked · 127 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“some studies of training and organisational approaches to increase participation, decision-making, and work support and communication have reduced sickness absence.13”
§ Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study > Background
What the sources say
- Supportedcites [13] source
The Abstract and the Main messages/DISCUSSION state verbatim that successful interventions which improved psychological health and levels of sickness absence used training and organisational approaches to increase participation in decision making and problem solving, increase support and feedback, and improve communication; the abstract's conclusion repeats that intervention studies 'successfully improved psychological health and reduced sickness absence'. The Evaluated interventions section supplies the underlying studies (e.g. the organisational referral-pattern intervention, ref 53, which cut average absence duration). The citing paraphrase faithfully condenses this. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Training managers influences employee well-being”
§ Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study > Background
What the sources say
- Partly supportedcites [16] sourceExperimental — accuracy not yet measured
The paper's Conclusion reports that training improved supervisors’ knowledge and behavior regarding workplace stress management. Its Procedure describes measuring supervisors’ knowledge, attitudes, and behavior—not employee well-being. The introductory passage reports possible benefits for subordinates’ psychological distress in earlier trials, but this trial does not establish the claim’s employee-well-being outcome. (LLM, conf=0.86)
- Supportedcites [17] Tsutsumi, 2005, Effects of supervisory education for positive mental health in the workplace: a quasi-experimental study, J Occup Health source
The Results report significantly improved psychological distress among non-supervisors in departments with high supervisor-training attendance. The Discussion describes this as suggestive evidence of a positive effect on employee psychological well-being, supporting the broad claim without establishing a definitive causal effect. (LLM, conf=0.89)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Three reviews of interventions within organisations7–9 showed mixed evidence of benefit on health outcomes”
§ Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study > Background
What the sources say
- Supportedcites [7] Marine A , Ruotsalainen J , Serra C , et al . Preventing occupational stress in healthcare workers. Cochrane Database Sys Rev 2006;(4):CD002892. source
The review’s Organisational interventions section reports that shorter or interrupted work schedules reduced stress, while other organisational interventions showed no clear benefit. This supports the citing sentence’s characterization of mixed evidence for health benefits from organisational interventions; this verdict addresses this review, not the other two citations. (LLM, conf=0.90)
- Not checked yetcites [8] source
- Not checked yetcites [9] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“There is empirical evidence including several meta-analyses, showing that the psychosocial work environment in terms of job strain, low social support at work from managers and colleagues, effort-reward imbalance, organisational injustice and job insecurity impacts on employee well-being and risk of sickness absence.”
§ Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study > Background
What the sources say
- Partly supportedcites [1] sourceExperimental — accuracy not yet measured
The Abstract and Discussion (page not specified) link job strain, low workplace social support, effort–reward imbalance, and job insecurity to common mental disorders. The Limitations section also reports an association between organisational justice and common mental disorders, but says those studies were not included in the meta-analysis. The review does not establish the claimed risk of sickness absence; its reference to psychiatric sickness absence concerns an adjustment used in another study. (LLM, conf=0.90)
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
The introduction links low control, high demands, and low work support to ill health and sickness absence; the Results and Discussion report associations with long spells of absence. The paper also discusses job insecurity, but the passages do not address effort–reward imbalance or organisational injustice, and they do not substantiate the sentence’s reference to several meta-analyses. Page numbers are unavailable in our copy. (LLM, conf=0.86)
- Not checked yetcites [3] source
- Partly supportedcites [4] Bhui, 2012, A synthesis of the evidence for managing stress at work: a review of the reviews reporting on anxiety, depression, and absenteeism, J Environ Public Health sourceExperimental — accuracy not yet measured
The Introduction identifies job strain, low social support, effort–reward imbalance and job insecurity as implicated in anxiety and depressive illness, and says work stress can lead to sickness absence. It does not identify organisational injustice or specify support from managers and colleagues. Nor does it establish that each listed factor affects sickness absence; the review’s absenteeism findings concern interventions (Results, §4.3). (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and 51.0–49.9 in the intervention (n=225)”
§ Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study > Abstract > Results
plainn = 225- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
82 more claims
Create a free account to see all 146 claims and to verify the 17 references still open.
- Probably not a substantial claim. 41
- It may state two separate claims as one. 32
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A small significant positive effect on employee well-being was reported postintervention compared with controls although there was no change in psychological distress, supervisor relationships or support, or sickness absence.”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A small significant positive effect on employee well-being was reported postintervention compared with controls although there was no change in psychological distress, supervisor relationships or support, or sickness absence.”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [25]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“When qualitative work is reported within the primary report of a pilot trial,27 it is not always possible to put sufficient detail into the methods section of the report to comply with reporting guidelines for qualitative studies.”
From CONSORT 2010 statement: extension to randomised pilot and feasibility trials. (2016) · cites this paper as [27]
In the citing paper
“Moreover, low levels of user adherence (i.e., failure to complete an intervention as prescribed by the researchers) are a common issue with web-based interventions65) and were observed in many of studies reviewed here25,28,37,52).”
From Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy (2017) · cites this paper as [25]
Citations
Cites
“Stress: appraisal and coping,”
Folkman, S. (2013) · Encyclopedia of Behavioral Medicine · doi:10.1007/978-1-4419-1005-9_215 · Cited by 27,833
Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign
Karasek, R. A. (1979) · Administrative Science Quarterly · doi:10.2307/2392498 · Cited by 12,597 · cited 3×
“Proportion employees with GHQ12 score >3 106 (37) 18 (31) 0.”
The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation
Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., Parkinson, J., Secker, J., & Stewart-Brown, S. (2007) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-5-63 · Cited by 5,031
Two decades of research and development in transformational leadership
Bass, B. M. (1999) · European Journal of Work and Organizational Psychology · doi:10.1080/135943299398410 · Cited by 3,254 · cited 1×
“0) Intervention 228 80 (23) 80 (24) −0.”
Psychosocial work environment and mental health—a meta-analytic review
Stansfeld, S., & Candy, B. (2006) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.1050 · Cited by 1,875 · cited 3×
“Interpretation of findings The small difference in well-being between the intervention and control groups may be due to several factors: (1) insufficient interval between intervention and follow-up employee well-being measurements, (2) choice of well-being measure, (3) the confounding effects of considerable organisat…”
BackgroundMethodSelf-citationEffects of occupational stress management intervention programs: A meta-analysis.
Richardson, K. M., & Rothstein, H. R. (2008) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.13.1.69 · Cited by 1,374 · cited 1×
“Employees with disability or limited activities 44 (15) 5 (8) 0.”
BackgroundThe benefits of interventions for work-related stress
(2001) · American Journal of Public Health · doi:10.2105/ajph.91.2.270 · Cited by 999
Reducing work related psychological ill health and sickness absence: a systematic literature review
Michie, S., & Williams, S. (2003) · Occupational and Environmental Medicine · doi:10.1136/oem.60.1.3 · Cited by 816
Preventing occupational stress in healthcare workers
Ruotsalainen, J. H., Verbeek, J. H., Mariné, A., & Serra, C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub5 · Cited by 563
Preventing occupational stress in healthcare workers
Marine, A., Ruotsalainen, J. H., Serra, C., & Verbeek, J. H. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub2 · Cited by 499
Research works printed but not linked: 2
- Boorman S . NHS health and wellbeing review. Leeds, UK: COI for the Department of Health, 2009.
- Muller J . Narrative approaches to qualitative research in primary care. In: Crabtree BF , Miller WF , eds. Doing qualitative research. 2nd edn. London: Sage Publications, 1999:221–38.
Cited by
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Stratton, E., Lampit, A., Choi, I., Calvo, R. A., Harvey, S. B., & Glozier, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0189904 · Cited by 252
Milligan-Saville, J. S., Tan, L., Gayed, A., Barnes, C., Madan, I., Dobson, M., Bryant, R. A., Christensen, H., Mykletun, A., & Harvey, S. B. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30372-3 · Cited by 169
Watson, D. J., Tregaskis, O., Gedikli, Ç., Vaughn, O., & Semkina, A. (2018) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2018.1435529 · Cited by 160
“approach; 34 of 41 studies employed only quantitative methods, 6 were mixed-methods approaches (Biglan, Layton, Jones, Hankins, & Rusby, 2013; McGarrigle & Walsh, 2011; Morgan & Konrad, 2008; Nielsen, Randall, & Christensen, 2010; Stansfeld et al., 2015; Traeger et al., 2013) and one took a purely qualitative approach…”
BackgroundInfluential
Metadata
- Authors
- Stansfeld, S. A., Kerry, S., Chandola, T., Russell, J., Berney, L., Hounsome, N., Lanz, D., Costelloe, C., Smuk, M., & Bhui, K.
- Affiliations
- University of London (GB)
- University of Manchester (GB)
- Corresponding author
- Stansfeld, Stephen A
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-10
- Volume
- 5
- Issue
- 10
- Pages
- e007981
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC4636656
- OpenAlex
- W1851249733
- Cited by
- 53
- References
- 37
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 6 · 2023: 5 · 2022: 6 · 2021: 8 · 2020: 5 · 2019: 4 · 2018: 4 · 2017: 6 · 2016: 3 · 2015: 1
- FWCI
- 8.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Repository (Kingston University London) (acceptedVersion)
- Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Research Explorer (The University of Manchester) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- Public Health Wales
- National Institute for Health and Care Research (10/3007/06)
- University of Warwick
- Cardiff University
- Health and Safety Executive
- Economic and Social Research Council (ES/J019119/1)
- Menzies Centre for Australian Studies, King's College London, University of London
- Public Health Research Programme (10/3007/06)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Workplace Health and Well-being
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Keywords
- e-learning intervention, managers, employee well-being, sick leave, occupational stress, mental health services, workplace health promotion, intervention feasibility, intervention uptake, Warwick-Edinburgh Mental Well-being Scale, General Health Questionnaire
- MeSH terms
- Adult, Female, Health Education, Health Promotion, Humans, London, Male, Mental Health, Middle Aged, Pilot Projects, Telemedicine, Sick Leave
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study. https://app.cochat.ai/papers/10.1136/bmjopen-2015-007981
- The paper
- Stansfeld, S. A., Kerry, S., Chandola, T., Russell, J., Berney, L., Hounsome, N., Lanz, D., Costelloe, C., Smuk, M., & Bhui, K. (2015). Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study. BMJ Open. https://doi.org/10.1136/bmjopen-2015-007981
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

