Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The persistent gap between research and practice compromises the impact of multi-level and multi-strategy community health interventions. Part of the problem is a limited understanding of how and why interventions produce change in population health outcomes. Systematic investigation of these intervention processes across studies requires sufficient reporting about interventions. Guided by a set of best processes related to the design, implementation, and evaluation of community health interventions, this article presents preliminary findings of intervention reporting in the published literature using community heart health exemplars as case examples. METHODS: The process to assess intervention reporting involved three steps: selection of a sample of community health intervention studies and their publications; development of a data extraction tool; and data extraction from the publications. Publications from three well-resourced community heart health exemplars were included in the study: the North Karelia Project, the Minnesota Heart Health Program, and Heartbeat Wales. RESULTS: Results are organized according to six themes that reflect best intervention processes: integrating theory, creating synergy, achieving adequate implementation, creating enabling structures and conditions, modifying interventions during implementation, and facilitating sustainability. In the publications for the three heart health programs, reporting on the intervention processes was variable across studies and across processes. CONCLUSION: Study findings suggest that limited reporting on intervention processes is a weak link in research on multiple intervention programs in community health. While it would be premature to generalize these results to other programs, important next steps will be to develop a standard tool to guide systematic reporting of multiple intervention programs, and to explore reasons for limited reporting on intervention processes. It is our contention that a shift to more inclusive reporting of intervention processes would help lead to a better understanding of successful or unsuccessful features of multi-strategy and multi-level interventions, and thereby improve the potential for effective practice and outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Translating Social Ecological Theory into Guidelines for Community Health Promotion
Stokols, D. (1996) · American Journal of Health Promotion · doi:10.4278/0890-1171-10.4.282 · Cited by 2,763
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
Reconsidering Community-Based Health Promotion: Promise, Performance, and Potential
Merzel, C., & D’Afflitti, J. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.4.557 · Cited by 713
Proximal, Distal, and the Politics of Causation: What’s Level Got to Do With It?
Krieger, N. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.111278 · Cited by 535 · cited 2×
“Of particular relevance to these programs are failures to either describe or take into account community involvement in the design stages of an intervention [8]; the dynamic, pervasive, and historical influences of inner and outer implementation contexts [12,14-17]; or pathways for change [13,14].”
Sustaining Community‐Based Programs for Families: Conceptualization and Measurement*
Mancini, J. A., & Marek, L. I. (2004) · Family Relations · doi:10.1111/j.0197-6664.2004.00040.x · Cited by 199 · cited 1×
“, sustainability, synergy) [46-51].”
Improving the reporting of public health intervention research: advancing TREND and CONSORT
Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., & Hawe, P. (2008) · Journal of Public Health · doi:10.1093/pubmed/fdm082 · Cited by 171
Research works printed but not linked: 42
- Edwards N, Mill J, Kothari AR: Multiple intervention research programs in community health. Can J Nurs Res. 2004, 36: 40-54.
- Ciliska D, Jull A, Thompson C, (Eds): Purpose and procedure. Evid Based Nurs. 2008, 11: 1-2. · DOI
- Haynes B, Gasziou P, (Eds): Purpose and procedure. Evid Based Med. 2007, 12: 161-10.1136/ebm.12.6.161. · doi:10.1136/ebm.12.6.161
- Reid S, (Ed): Purpose and procedure. Evid Based Ment Health. 2008, 11: 1-2. 10.1136/ebmh.11.1.1. · doi:10.1136/ebmh.11.1.1
- Edwards N, MacLean L, Estable A, Meyer M: Multiple intervention program recommendations for MHPSG technical review committees. 2006, Ottawa, Ontario: Community Health Research Unit
- Smedley B, Syme SL: Promoting health: intervention strategies from social and behavioral research. Am J Health Promot. 2001, 15: 149-166. · DOI · Paper page
- Brownson RC, Haire-Joshu D, Luke DA: Shaping the context of health: a review of environmental and policy approaches in the prevention of chronic diseases. Annu Rev Public Health. 2006, 27: 341-370. 10.1146/annurev.publhealth.27.021405.102137. · DOI · Paper page
- Dooris M, Poland B, Kolbe L, deLeeuw E, McCall D, Wharf-Higgins J: Healthy settings: building evidence for the effectiveness of whole system health promotion – challenges & future directions. Global Perspectives on Health Promotion Effectiveness. Edited by: McQueen D, Jones C. 2007, New York: Springer, 1:
- Edwards N, Clinton K: Context in health promotion and chronic disease prevention. Background document prepared for Public Health Agency of Canada. 2008
- Greenhalgh P, Robert G, MacFarlane F, Bates SP, Kyriakidou O, Peacock R: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x. · DOI · Paper page
- McLaren L, Ghali LM, Lorenzetti D, Rock M: Out of context? Translating evidence from The North Karelia project over place and time. Health Educ Res. 2007, 22: 414-424. 10.1093/her/cyl097. · DOI · Paper page
- COMMIT Research Group: Community intervention trial for smoking cessation (COMMIT): summary of design and intervention. J Natl Cancer Inst. 1991, 83: 1620-1628. 10.1093/jnci/83.22.1620. · DOI · Paper page
- CART Project Team: Community action for health promotion: a review of methods and outcomes 1990–1995. Am J Prev Med. 1997, 13: 229-239. · DOI
- Best A, Stokols D, Green LW, Leischow S, Holmes B, Buchholz K: An integrative framework for community partnering to translate theory into effective health promotion strategy. Am J Health Promot. 2003, 18: 168-176. · DOI · Paper page
- Deschesnes M, Martin C, Hill AJ: Comprehensive approaches to school health promotion: how to achieve broader implementation?. Health Promot Int. 2003, 18: 387-396. 10.1093/heapro/dag410. · DOI · Paper page
- Ebrahim S, Smith GD: Exporting failure? Coronary heart disease and stroke in developing countries. Int J Epidemiol. 2001, 30: 201-205. 10.1093/ije/30.2.201. · DOI · Paper page
- Koepsell TD, Wagner EH, Cheadle AC, Patrick DL, Martin DC, Diehr PH, Perrin EB, Kristal AR, Allan-Andrilla CH, Dey LJ: Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annu Rev Public Health. 1992, 13: 31-57. 10.1146/annurev.pu.13.050192.000335. · DOI · Paper page
- Dobbins M, Beyers J: The effectiveness of community-based heart health projects: a systematic overview update. 1999, Hamilton, Ontario: Effective Public Health Practice Project
- Goodman RM: Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000, 28: 309-321. 10.1002/(SICI)1520-6629(200005)28:3<309::AID-JCOP6>3.0.CO;2-O. · DOI
- Centres for Disease Control (CDC): Best practices for comprehensive tobacco control programs. 1999, Atlanta, US: Department of Health and Human Services, CDC, National Centre for Chronic Disease Prevention and Health Promotion
- Richard L, Lehoux P, Breton E, Denis J, Labrie L, Léonard C: Implementing the ecological approach in tobacco control programs: results of a case study. Eval Program Plann. 2004, 27: 409-421. 10.1016/j.evalprogplan.2004.07.004. · DOI
- Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28: 226-230. 10.1016/j.amepre.2005.02.014. · DOI · Paper page
- Pang T, Sadana R, Hanney S, Bhutta ZA, Hyder AA, Simon J: Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ. 2003, 81: 815-820.
- Public Health Research, Education and Development Program: Effective public health practice project. 2005, Hamilton: McMaster University, [ http://www.myhamilton.ca/myhamilton/CityandGovernment/HealthandSocialServices/Research/EPHPP/AboutEPHPP.asp ]
- Kelder S, Perry C, Klepp K: Community-wide youth exercise promotion: long-term outcomes of the Minnesota heart health program and the class of 1989 study. J Sch Health. 1993, 63: 218-223. · DOI · Paper page
- Lando H, Pechacek T, Pirie P, Murray D, Mittelmark M, Lichtenstein E, Nothwehr F, Gray C: Changes in adult cigarette smoking in the Minnesota heart health program. Am J Public Health. 1995, 85: 201-208. · DOI · Paper page
- Luepkar R, Murray D, Jacobs D, Mittelmark M: Community education for cardiovascular disease prevention: risk factor changes in the Minnesota heart health program. Am J Public Health. 1994, 84: 1383-1393. · DOI · Paper page
- Perry C, Kelder S, Murray D, Klepp K: Communitywide smoking prevention: long term outcomes of the Minnesota heart health program and class of 1989 study. Am J Public Health. 1992, 82: 1210-1216. · DOI · Paper page
- Nutbeam D, Catford J: The Welsh heart programme evaluation strategy: progress, plans and possibilities. Health Promot. 1987, 2: 5-18. 10.1093/heapro/2.1.5. · DOI
- Nutbeam D, Smith C, Simon M, Catford J: Maintaining evaluation design in long term community based health promotion programmes: Heartbeat Wales case study. J Epidemiol Community Health. 1993, 47: 127-133. · DOI · Paper page
- Smail S, Parish R: Heartbeat Wales – a community programme. Practitioner. 1989, 233: 343-347.
- Tudor-Smith C, Nutbeam D, More L, Catford J: Effects of Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and matched areas. BMJ. 1998, 316: 818-822. · DOI · Paper page
- Phillips CJ, Prowle MJ: Economics of a reduction in smoking: case study from Heartbeat Wales. J Epidemiol Community Health. 1993, 47: 215-223. · DOI
- Directorate of the Welsh Heart Programme: Take Heart: A consultative document on the development of community-based heart health initiatives within Wales. Cardiff. 1985
- Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9: 1-12.
- Riley B: OHHP: Taking Action for Healthy Living Local Reporting Forms. Data collection tools prepared for the Ontario Ministry of Health and Long-Term Care for monitoring and evaluating the OHHP (2003–2008). 2003
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa: University of Florida
- Last J: A Dictionary of Epidemiology. 2001, Oxford: University Press
- McLeroy K, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Educ Q. 1988, 15: 351-377. · DOI · Paper page
- Richard L, Potvin L, Kishchuk N, Prlic H, Green LW: Assessment of the integration of the ecological approach in health promotion programs. Am J Health Promot. 1996, 10: 318-328. · DOI · Paper page
- Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585. · DOI · Paper page
- Mol A: Proving or improving: on health care research as a form of self-reflection. Qual Health Res. 2006, 16: 405-414. 10.1177/1049732305285856. · DOI · Paper page
Cited by
Theorising interventions as events in systems
Hawe, P., Shiell, A., & Riley, T. (2009) · American Journal of Community Psychology · doi:10.1007/s10464-009-9229-9 · Cited by 1,143
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Kemp, C. G., Jarrett, B. A., Kwon, C.-S., Song, L., Jetté, N., Sapag, J. C., Bass, J., Murray, L., Rao, D., & Baral, S. (2019) · BMC Medicine · doi:10.1186/s12916-018-1237-x · Cited by 138
Methods and metrics challenges of delivery-system research
Alexander, J. A., & Hearld, L. R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-15 · Cited by 78
The next phase in professional services research: From implementation to sustainability
Crespo-Gonzalez, C., Garcia-Cardenas, V., & Benrimoj, S. I. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.020 · Cited by 45
Metadata
- Authors
- Riley, B. L., MacDonald, J., Mansi, O., Kothari, A., Kurtz, D., vonTettenborn, L. I., & Edwards, N. C.
- Venue
- Implementation Science
- Published
- 2008-05-20
- Volume
- 3
- Issue
- 1
- Pages
- 27-27
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2070730818
- Cited by
- 44
- References
- 9
- FWCI
- 6.20
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. https://app.cochat.ai/papers/10.1186/1748-5908-3-27
- The paper
- Riley, B. L., MacDonald, J., Mansi, O., Kothari, A., Kurtz, D., vonTettenborn, L. I., & Edwards, N. C. (2008). Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. Implementation Science. https://doi.org/10.1186/1748-5908-3-27
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.