The Relationship between Return on Investment and Quality of Study Methodology in Workplace Health Promotion Programs
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Objective.: To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs. Data Source.: Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus. Study Inclusion and Exclusion Criteria.: Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded. Data Extraction.: Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI. Data Synthesis.: ROI was calculated as ROI = (benefits − costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored. Results.: Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84–.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38–1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n= 18) had a smaller mean ROI, 0.26 ± 1.74 (.23–.30), compared to moderate (n= 16) 0.90 ± 1.25 (.90–.91) and low-quality (n= 27) 2.32 ± 2.14 (2.30–2.33) studies. Randomized control trials (RCTs) (n= 12) exhibited negative ROI, −0.22 ± 2.41(–.27 to –.16). Financial returns become increasingly positive across quasi-experimental nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11–1.14), 1.61 ± 0.91 (1.56–1.65), and 2.05 ± 0.88 (2.04–2.06), respectively. Conclusion.: Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477 · cited 1×
“findings derived from poorer methods maybe less robust and undermine generalizability due to their limited transparency, applicability, and uncertainty of result, which the methodological quality score reflects.(11,12,22) Methodological quality has improved at a rate of 1.”
MethodFinancial impact of health promotion programs, a comprehensive review of the literature
Aldana, S. G. (2001) · American Journal of Health Promotion · doi:10.4278/0890-1171-15.5.296 · Cited by 558
Pelletier, K. R. (2001) · American Journal of Health Promotion · doi:10.4278/0890-1171-16.2.107 · Cited by 341
Financial impact of a comprehensive multisite workplace health promotion program
ALDANA, S., MERRILL, R., PRICE, K., HARDY, A., & HAGER, R. (2005) · Preventive Medicine · doi:10.1016/j.ypmed.2004.05.008 · Cited by 234 · cited 1×
“Aldana et al.(47) 2005 Quasi USA 2 PS Education 1264 3575 N, Wt, PA, SF,”
BackgroundPelletier, K. R. (2005) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000174303.85442.bf · Cited by 147
Workplace health promotion and utilization of health services: Follow-up data findings
Deitz, D., Cook, R., & Hersch, R. (2005) · The Journal of Behavioral Health Services & Research · doi:10.1007/bf02291830 · Cited by 33
Worksite Health Promotion: The Value of the Tune Up Your Heart Program
Chung, M., Melnyk, P., Blue, D., Renaud, D., & Breton, M.-C. (2009) · Population Health Management · doi:10.1089/pop.2008.0044 · Cited by 25
Cited by
What do Workplace Wellness Programs do? Evidence from the Illinois Workplace Wellness Study*
Jones, D., Molitor, D., & Reif, J. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz023 · Cited by 403
Sanchez-Gomez, M., Giorgi, G., Finstad, G. L., Urbini, F., Foti, G., Mucci, N., Zaffina, S., & León-Perez, J. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147422 · Cited by 75
“The implementation of workplace health promotion programs is advisable, as practical interventions have demonstrated a positive return on investment [47,48].”
BackgroundEconomic evaluations of workplace mental health interventions: a critical review
Nogues, S., & Finucan, J. (2018) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1002/cjas.1502 · Cited by 10
Howarth, A., Quesada, J., Donnelly, T., & Mills, P. R. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619852856 · Cited by 9
Metadata
- Authors
- Baxter, S., Sanderson, K., Venn, A. J., Blizzard, C. L., & Palmer, A. J.
- Venue
- American Journal of Health Promotion
- Publisher
- SAGE Publications
- Published
- 2014-07
- Volume
- 28
- Issue
- 6
- Pages
- 347-363
- ISSN
- 0890-1171 (ISSN-L)
- 2168-6602
- OpenAlex
- W2103010888
- Cited by
- 206
- References
- 8
- FWCI
- 47.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Relationship between Return on Investment and Quality of Study Methodology in Workplace Health Promotion Programs. https://app.cochat.ai/papers/10.4278/ajhp.130731-lit-395
- The paper
- Baxter, S., Sanderson, K., Venn, A. J., Blizzard, C. L., & Palmer, A. J. (2014). The Relationship between Return on Investment and Quality of Study Methodology in Workplace Health Promotion Programs. American Journal of Health Promotion. https://doi.org/10.4278/ajhp.130731-lit-395
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.