Assessing capacity for sustainability of effective programs and policies in local health departments
Open accessAbstract
CONTEXT: Sustainability has been defined as the existence of structures and processes that allow a program to leverage resources to effectively implement and maintain evidence-based public health and is important in local health departments (LHDs) to retain the benefits of effective programs. OBJECTIVE: Explore the applicability of the Program Sustainability Framework in high- and low-capacity LHDs as defined by national performance standards. DESIGN: Case study interviews from June to July 2013. Standard qualitative methodology was used to code transcripts; codes were developed inductively and deductively. SETTING: Six geographically diverse LHD's (selected from 3 of high and 3 of low capacity) PARTICIPANTS: : 35 LHD practitioners. MAIN OUTCOME MEASURES: Thematic reports explored the 8 domains (Organizational Capacity, Program Adaptation, Program Evaluation, Communications, Strategic Planning, Funding Stability, Environmental Support, and Partnerships) of the Program Sustainability Framework. RESULTS: High-capacity LHDs described having environmental support, while low-capacity LHDs reported this was lacking. Both high- and low-capacity LHDs described limited funding; however, high-capacity LHDs reported greater funding flexibility. Partnerships were important to high- and low-capacity LHDs, and both described building partnerships to sustain programming. Regarding organizational capacity, high-capacity LHDs reported better access to and support for adequate staff and staff training when compared with low-capacity LHDs. While high-capacity LHDs described integration of program evaluation into implementation and sustainability, low-capacity LHDs reported limited capacity for measurement specifically and evaluation generally. When high-capacity LHDs described program adoption, they discussed an opportunity to adapt and evaluate. Low-capacity LHDs struggled with programs requiring adaptation. High-capacity LHDs described higher quality communication than low-capacity LHDs. High- and low-capacity LHDs described strategic planning, but high-capacity LHDs reported efforts to integrate evidence-based public health. CONCLUSIONS: Investments in leadership support for improving organizational capacity, improvements in communication from the top of the organization, integrating program evaluation into implementation, and greater funding flexibility may enhance sustainability of evidence-based public health in LHDs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Funding is often identified as the major barrier to program sustainment.
“Funding is often identified as the major barrier to program sustainment [20, 31, 55].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [31]
The Results (Funding Stability; page unavailable) report that funding limitations impeded sustainability in the local health departments studied and that limited flexibility in using funds was seen as a major barrier, particularly in low-capacity departments. The Discussion (page unavailable) calls funding a major issue for all departments interviewed, but the paper does not establish it as the single major barrier to program sustainment generally. (LLM, conf=0.86)
Experimental — accuracy not yet measuredThe PSAT has been employed in several sustainability studies, but these studies have been primarily descriptive and seldom examined predictive strength between PSAT domains and program sustainment.
“Since its inception, the PSAT has been employed in several sustainability studies, though the studies have been primarily descriptive, seldom examining the predictive strength between the PSAT domains and program sustainment [30, 31].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [31]
The Methods (Summary Table; page unavailable) describe a thematic comparison using eight sustainability-framework domains, and the Discussion (Limitations; page unavailable) says the study could not assess actual program sustainment or cause and effect. This supports describing this study as non-predictive, but it does not establish that several studies employed the PSAT itself or that such studies were primarily descriptive. (LLM, conf=0.79)
Experimental — accuracy not yet measuredFindings are consistent with previous research using the PSAT showing higher levels of environmental support are reported by programs with greater sustainment success.
“Our findings are consistent with previous research using the PSAT showing higher levels of environmental support are reported by programs with greater sustainment success [31, 32, 42].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [31]
The Results (Environmental Support; page unavailable) say staff at high-capacity local health departments described having environmental support, while staff at low-capacity departments said it was lacking. But the Methods (Case Study Sample Selection; page unavailable) define capacity using performance scores, not program sustainment success, and describe interviews rather than use of the PSAT instrument. (LLM, conf=0.87)
Experimental — accuracy not yet measuredTabak et al. found both sites with high and low sustainment capacity reporting limited funding stability.
“This finding appears to be in line with a study by Tabak and colleagues [31] that found both sites with high and low sustainment capacity reporting limited funding stability.”
Empirical research shows organizational capacity, such as having adequate resources and staff to deliver the program, is integral to a program's success and continued delivery.
“and that organizational capacity, such as having adequate resources and staff to deliver the program [19, 24, 31, 53] is integral to a program’s success and continued delivery.”
Tabak et al. found high-capacity sites integrated program evaluation into their implementation and sustainability, while low-capacity sites reported limited evaluation capacity.
“Similarly, Tabak and colleagues [31] found that high-capacity sites integrated program evaluation into their implementation and sustainability, while low-capacity sites reported limited evaluation capacity.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Ten Great Public Health Achievements—United States, 1900-1999
(1999) · JAMA · doi:10.1001/jama.281.16.1481 · Cited by 1,299 · see citing works
Evidence-Based Public Health: A Fundamental Concept for Public Health Practice
Brownson, R. C., Fielding, J. E., & Maylahn, C. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100134 · Cited by 1,138 · see citing works
Self-citationPublic health program capacity for sustainability: a new framework
Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-15 · Cited by 563 · see citing works
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1162 · Cited by 525 · see citing works
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182447 · Cited by 474 · see citing works
The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs
Luke, D. A., Calhoun, A., Robichaux, C. B., Elliott, M. B., & Moreland-Russell, S. (2014) · Preventing Chronic Disease · doi:10.5888/pcd11.130184 · Cited by 364 · see citing works
Self-citationTen great public health achievements--United States, 1900-1999.
(1999) · PubMed · Cited by 342 · see citing works
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.8.1162 · Cited by 341 · see citing works
Measuring the Diffusion of Innovative Health Promotion Programs
Steckler, A., Goodman, R. M., McLeroy, K. R., Thomas, S., & Koch, G. G. (1992) · American Journal of Health Promotion · doi:10.4278/0890-1171-6.3.214 · Cited by 238 · see citing works
Sustainability of Collaborative Capacity in Community Health Partnerships
Alexander, J. A., Weiner, B. J., Metzger, M. E., Shortell, S. M., Bazzoli, G. J., Hasnain-Wynia, R., Sofaer, S., & Conrad, D. A. (2003) · Medical Care Research and Review · doi:10.1177/1077558703259069 · Cited by 154 · see citing works
Evidence-Based Interventions to Promote Physical Activity
Brownson, R. C., Ballew, P., Dieffenderfer, B., Haire-Joshu, D. L., Heath, G. W., Kreuter, M. W., & Myers, B. A. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.03.011 · Cited by 116 · see citing works
Self-citationLewis, L. K. (2006) · Western Journal of Communication · doi:10.1080/10570310500506631 · Cited by 114 · see citing works
Fostering More-Effective Public Health by Identifying Administrative Evidence-Based Practices
Brownson, R. C., Allen, P. M., Duggan, K., Stamatakis, K. A., & Erwin, P. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.06.006 · Cited by 113 · see citing works
Self-citationBrownson, R. C., Ballew, P., Brown, K. L., Elliott, M., Haire-Joshu, D. L., Heath, G. W., & Kreuter, M. W. (2007) · American Journal of Public Health · doi:10.2105/ajph.2006.090399 · Cited by 105 · see citing works
Self-citationDiffusion of an effective tobacco prevention program. Part II: evaluation of the adoption phase
Parcel, G. S., O'Hara-Tompkins, N. M., Harrist, R. B., Basen-Engquist, K. M., McCormick, L. K., Gottlieb, N. H., & Eriksen, M. P. (1995) · Health Education Research · doi:10.1093/her/10.3.297 · Cited by 101 · see citing works
Using the Program Sustainability Assessment Tool to Assess and Plan for Sustainability
Calhoun, A., Mainor, A., Moreland-Russell, S., Maier, R. C., Brossart, L., & Luke, D. A. (2014) · Preventing Chronic Disease · doi:10.5888/pcd11.130185 · Cited by 100 · see citing works
Self-citationSustainability of Social Programs: A Comparative Case Study Analysis
Savaya, R., Spiro, S., & Elran-Barak, R. (2008) · American Journal of Evaluation · doi:10.1177/1098214008325126 · Cited by 98 · see citing works
Diffusion of an effective tobacco prevention program. Part I: evaluation of the dissemination phase
Brink, S. G., Basen-Engquist, K. M., O'Hara-Tompkins, N. M., Parcel, G. S., Gottlieb, N. H., & Lovato, C. Y. (1995) · Health Education Research · doi:10.1093/her/10.3.283 · Cited by 71 · see citing works
A survey tool for measuring evidence-based decision making capacity in public health agencies
Jacobs, J. A., Clayton, P., Dove, C., Funchess, T. T., Jones, E., Perveen, G., Skidmore, B., Sutton, V. D., Worthington, S., Baker, E. A., et al. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-57 · Cited by 68 · see citing works
Self-citationJourney toward a Patient-Centered Medical Home: Readiness for Change in Primary Care Practices
Wise, C. G., Alexander, J. A., Green, L. A., Cohen, G. R., & KOSTER, C. R. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00634.x · Cited by 63 · see citing works
Understanding Administrative Evidence-Based Practices
Brownson, R. C., Reis, R. S., Allen, P. M., Duggan, K., Fields, R. P., Stamatakis, K. A., & Erwin, P. C. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.08.013 · Cited by 59 · see citing works
Self-citationOrganizational Change Strategies for Evidence-Based Practice
Newhouse, R. P., Dearholt, S., Poe, S., et al. (2007) · JONA The Journal of Nursing Administration · doi:10.1097/01.nna.0000302384.91366.8f · Cited by 51 · see citing works
Creating Quality Improvement Culture in Public Health Agencies
Davis, M. V., Mahanna, E., Joly, B. M., et al. (2013) · American Journal of Public Health · doi:10.2105/ajph.2013.301413 · Cited by 38 · see citing works
Dissemination of heart health promotion in the Ontario Public Health System: 1989-1999
Riley, B. (2003) · Health Education Research · doi:10.1093/her/18.1.15 · Cited by 29 · see citing works
Evidence-Based Public Health Practice Among Program Managers in Local Public Health Departments
Erwin, P. C., Harris, J. K., Smith, C. A., Leep, C. J., Duggan, K., & Brownson, R. C. (2013) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000027 · Cited by 27 · see citing works
Self-citationDeveloping a Tool to Assess Administrative Evidence-Based Practices in Local Health Departments
Reis, R. S., Duggan, K., Allen, P. M., Stamatakis, K. A., Erwin, P. C., & Brownson, R. C. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.10412e43.2 · Cited by 19 · see citing works
Self-citationThe Makings of an Evidence-Based Local Health Department
Allen, P. M., Brownson, R. C., Duggan, K., et al. (2012) · UKnowledge (University of Kentucky) · doi:10.13023/fphssr.0102.02 · Cited by 16 · see citing works
Self-citationSpecial Healthcare Taxing Districts
Studnicki, J., Gipson, L. S., Berndt, D. J., Fisher, J. W., Callandar, M., Pracht, E. E., & Langland‐Orban, B. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2006.11.001 · Cited by 15 · see citing works
Evaluation of health promotion policies: tracking a moving target.
Milio, N. (2001) · PubMed · Cited by 14 · see citing works
Halm, M. A. (2010) · American Journal of Critical Care · doi:10.4037/ajcc2010627 · Cited by 9 · see citing works
Race-Differentiated Outcomes in Multiple Special Healthcare Taxing Districts
Studnicki, J., Fisher, J. W., & Kamble, S. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.11.006 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
Assessing the sustainability capacity of evidence-based programs in community and health settings
Bacon, C., Malone, S., Prewitt, K., Hackett, R., Hastings, M., Dexter, S., & Luke, D. A. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1004167 · Cited by 22 · see citing works
Examination of sustainability indicators for fall prevention strategies in three states
Smith, M. L., Durrett, N. K., Schneider, E. C., Byers, I. N., Shubert, T. E., Wilson, A. D., Towne, S. D., & Ory, M. G. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.02.001 · Cited by 22 · see citing works
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00303-4 · Cited by 7 · see citing works
“Funding is often identified as the major barrier to program sustainment [20, 31, 55].”
BackgroundMethodResultInfluential
- Authors
- Tabak, R. G., Duggan, K., Smith, C., Aisaka, K., Moreland-Russell, S., & Brownson, R. C.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Tabak, Rachel G.
- Venue
- Journal of Public Health Management and Practice
- Published
- 2016-03
- Volume
- 22
- Issue
- 2
- Pages
- 129-137
- ISSN
- 1078-4659 (ISSN-L)
- PMC
- PMC4635064
- OpenAlex
- W2414013503
- Cited by
- 40
- References
- 31
- Citations by year
- 2025: 3 · 2024: 5 · 2023: 4 · 2022: 10 · 2021: 5 · 2020: 6 · 2019: 1 · 2018: 2 · 2017: 4
- FWCI
- 3.65
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Public Health Management and Practice (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR000448)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092950)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Public Health Policies and Education
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Keywords
- program sustainability, local health departments, organizational capacity, evidence-based public health, program adaptation, program evaluation, partnership, strategic planning, environmental support, employee training
- MeSH terms
- Health Policy, Humans, Local Government, Public Health, Program Evaluation, Case-Control Studies, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review