CoChat

Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars

Open access
Riley, Barbara L, MacDonald, JoAnne, Mansi, Omaima, Kothari, Anita, Kurtz, Donna, vonTettenborn, Linda I, Edwards, Nancy C · 2008 · Implementation Science
Cited by 44

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

BACKGROUND: The persistent gap between research and practice compromises the impact of multi-level and multi-strategy community health interventions. Part of the problem is a limited understanding of how and why interventions produce change in population health outcomes. Systematic investigation of these intervention processes across studies requires sufficient reporting about interventions. Guided by a set of best processes related to the design, implementation, and evaluation of community health interventions, this article presents preliminary findings of intervention reporting in the published literature using community heart health exemplars as case examples. METHODS: The process to assess intervention reporting involved three steps: selection of a sample of community health intervention studies and their publications; development of a data extraction tool; and data extraction from the publications. Publications from three well-resourced community heart health exemplars were included in the study: the North Karelia Project, the Minnesota Heart Health Program, and Heartbeat Wales. RESULTS: Results are organized according to six themes that reflect best intervention processes: integrating theory, creating synergy, achieving adequate implementation, creating enabling structures and conditions, modifying interventions during implementation, and facilitating sustainability. In the publications for the three heart health programs, reporting on the intervention processes was variable across studies and across processes. CONCLUSION: Study findings suggest that limited reporting on intervention processes is a weak link in research on multiple intervention programs in community health. While it would be premature to generalize these results to other programs, important next steps will be to develop a standard tool to guide systematic reporting of multiple intervention programs, and to explore reasons for limited reporting on intervention processes. It is our contention that a shift to more inclusive reporting of intervention processes would help lead to a better understanding of successful or unsuccessful features of multi-strategy and multi-level interventions, and thereby improve the potential for effective practice and outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1748-5908-3-27

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 42

  1. Edwards N, Mill J, Kothari AR: Multiple intervention research programs in community health. Can J Nurs Res. 2004, 36: 40-54.
  2. Ciliska D, Jull A, Thompson C, (Eds): Purpose and procedure. Evid Based Nurs. 2008, 11: 1-2. · DOI
  3. Haynes B, Gasziou P, (Eds): Purpose and procedure. Evid Based Med. 2007, 12: 161-10.1136/ebm.12.6.161. · doi:10.1136/ebm.12.6.161
  4. Reid S, (Ed): Purpose and procedure. Evid Based Ment Health. 2008, 11: 1-2. 10.1136/ebmh.11.1.1. · doi:10.1136/ebmh.11.1.1
  5. Edwards N, MacLean L, Estable A, Meyer M: Multiple intervention program recommendations for MHPSG technical review committees. 2006, Ottawa, Ontario: Community Health Research Unit
  6. Smedley B, Syme SL: Promoting health: intervention strategies from social and behavioral research. Am J Health Promot. 2001, 15: 149-166. · DOI · Paper page
  7. Brownson RC, Haire-Joshu D, Luke DA: Shaping the context of health: a review of environmental and policy approaches in the prevention of chronic diseases. Annu Rev Public Health. 2006, 27: 341-370. 10.1146/annurev.publhealth.27.021405.102137. · DOI · Paper page
  8. Dooris M, Poland B, Kolbe L, deLeeuw E, McCall D, Wharf-Higgins J: Healthy settings: building evidence for the effectiveness of whole system health promotion – challenges & future directions. Global Perspectives on Health Promotion Effectiveness. Edited by: McQueen D, Jones C. 2007, New York: Springer, 1:
  9. Edwards N, Clinton K: Context in health promotion and chronic disease prevention. Background document prepared for Public Health Agency of Canada. 2008
  10. Greenhalgh P, Robert G, MacFarlane F, Bates SP, Kyriakidou O, Peacock R: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x. · DOI · Paper page
  11. McLaren L, Ghali LM, Lorenzetti D, Rock M: Out of context? Translating evidence from The North Karelia project over place and time. Health Educ Res. 2007, 22: 414-424. 10.1093/her/cyl097. · DOI · Paper page
  12. COMMIT Research Group: Community intervention trial for smoking cessation (COMMIT): summary of design and intervention. J Natl Cancer Inst. 1991, 83: 1620-1628. 10.1093/jnci/83.22.1620. · DOI · Paper page
  13. CART Project Team: Community action for health promotion: a review of methods and outcomes 1990–1995. Am J Prev Med. 1997, 13: 229-239. · DOI
  14. Best A, Stokols D, Green LW, Leischow S, Holmes B, Buchholz K: An integrative framework for community partnering to translate theory into effective health promotion strategy. Am J Health Promot. 2003, 18: 168-176. · DOI · Paper page
  15. Deschesnes M, Martin C, Hill AJ: Comprehensive approaches to school health promotion: how to achieve broader implementation?. Health Promot Int. 2003, 18: 387-396. 10.1093/heapro/dag410. · DOI · Paper page
  16. Ebrahim S, Smith GD: Exporting failure? Coronary heart disease and stroke in developing countries. Int J Epidemiol. 2001, 30: 201-205. 10.1093/ije/30.2.201. · DOI · Paper page
  17. Koepsell TD, Wagner EH, Cheadle AC, Patrick DL, Martin DC, Diehr PH, Perrin EB, Kristal AR, Allan-Andrilla CH, Dey LJ: Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annu Rev Public Health. 1992, 13: 31-57. 10.1146/annurev.pu.13.050192.000335. · DOI · Paper page
  18. Dobbins M, Beyers J: The effectiveness of community-based heart health projects: a systematic overview update. 1999, Hamilton, Ontario: Effective Public Health Practice Project
  19. Goodman RM: Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000, 28: 309-321. 10.1002/(SICI)1520-6629(200005)28:3<309::AID-JCOP6>3.0.CO;2-O. · DOI
  20. Centres for Disease Control (CDC): Best practices for comprehensive tobacco control programs. 1999, Atlanta, US: Department of Health and Human Services, CDC, National Centre for Chronic Disease Prevention and Health Promotion
  21. Richard L, Lehoux P, Breton E, Denis J, Labrie L, Léonard C: Implementing the ecological approach in tobacco control programs: results of a case study. Eval Program Plann. 2004, 27: 409-421. 10.1016/j.evalprogplan.2004.07.004. · DOI
  22. Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28: 226-230. 10.1016/j.amepre.2005.02.014. · DOI · Paper page
  23. Pang T, Sadana R, Hanney S, Bhutta ZA, Hyder AA, Simon J: Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ. 2003, 81: 815-820.
  24. Public Health Research, Education and Development Program: Effective public health practice project. 2005, Hamilton: McMaster University, [ http://www.myhamilton.ca/myhamilton/CityandGovernment/HealthandSocialServices/Research/EPHPP/AboutEPHPP.asp ]
  25. Kelder S, Perry C, Klepp K: Community-wide youth exercise promotion: long-term outcomes of the Minnesota heart health program and the class of 1989 study. J Sch Health. 1993, 63: 218-223. · DOI · Paper page
  26. Lando H, Pechacek T, Pirie P, Murray D, Mittelmark M, Lichtenstein E, Nothwehr F, Gray C: Changes in adult cigarette smoking in the Minnesota heart health program. Am J Public Health. 1995, 85: 201-208. · DOI · Paper page
  27. Luepkar R, Murray D, Jacobs D, Mittelmark M: Community education for cardiovascular disease prevention: risk factor changes in the Minnesota heart health program. Am J Public Health. 1994, 84: 1383-1393. · DOI · Paper page
  28. Perry C, Kelder S, Murray D, Klepp K: Communitywide smoking prevention: long term outcomes of the Minnesota heart health program and class of 1989 study. Am J Public Health. 1992, 82: 1210-1216. · DOI · Paper page
  29. Nutbeam D, Catford J: The Welsh heart programme evaluation strategy: progress, plans and possibilities. Health Promot. 1987, 2: 5-18. 10.1093/heapro/2.1.5. · DOI
  30. Nutbeam D, Smith C, Simon M, Catford J: Maintaining evaluation design in long term community based health promotion programmes: Heartbeat Wales case study. J Epidemiol Community Health. 1993, 47: 127-133. · DOI · Paper page
  31. Smail S, Parish R: Heartbeat Wales – a community programme. Practitioner. 1989, 233: 343-347.
  32. Tudor-Smith C, Nutbeam D, More L, Catford J: Effects of Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and matched areas. BMJ. 1998, 316: 818-822. · DOI · Paper page
  33. Phillips CJ, Prowle MJ: Economics of a reduction in smoking: case study from Heartbeat Wales. J Epidemiol Community Health. 1993, 47: 215-223. · DOI
  34. Directorate of the Welsh Heart Programme: Take Heart: A consultative document on the development of community-based heart health initiatives within Wales. Cardiff. 1985
  35. Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9: 1-12.
  36. Riley B: OHHP: Taking Action for Healthy Living Local Reporting Forms. Data collection tools prepared for the Ontario Ministry of Health and Long-Term Care for monitoring and evaluating the OHHP (2003–2008). 2003
  37. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa: University of Florida
  38. Last J: A Dictionary of Epidemiology. 2001, Oxford: University Press
  39. McLeroy K, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Educ Q. 1988, 15: 351-377. · DOI · Paper page
  40. Richard L, Potvin L, Kishchuk N, Prlic H, Green LW: Assessment of the integration of the ecological approach in health promotion programs. Am J Health Promot. 1996, 10: 318-328. · DOI · Paper page
  41. Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585. · DOI · Paper page
  42. Mol A: Proving or improving: on health care research as a form of self-reflection. Qual Health Res. 2006, 16: 405-414. 10.1177/1049732305285856. · DOI · Paper page

Cited by

See all 44

Metadata

Authors
Riley, B. L., MacDonald, J., Mansi, O., Kothari, A., Kurtz, D., vonTettenborn, L. I., & Edwards, N. C.
Venue
Implementation Science
Published
2008-05-20
Volume
3
Issue
1
Pages
27-27
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2070730818
Cited by
44
References
9
FWCI
6.20
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. https://app.cochat.ai/papers/10.1186/1748-5908-3-27
The paper
Riley, B. L., MacDonald, J., Mansi, O., Kothari, A., Kurtz, D., vonTettenborn, L. I., & Edwards, N. C. (2008). Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. Implementation Science. https://doi.org/10.1186/1748-5908-3-27

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.