Understanding mis-implementation in Public Health practice
Open accessAbstract
Introduction A better understanding of mis-implementation in public health (ending effective programs and policies or continuing ineffective ones) may provide important information for decision makers. The purpose of this study is to describe the frequency and patterns in mis-implementation of programs in state and local health departments in the U.S.Methods A cross-sectional study of 944 public health practitioners was conducted. The sample included state (n=277) and local health department employees (n=398) and key partners from other agencies (n=269). Data were collected from October 2013 through June 2014 (analyzed in May through October 2014). Online survey questions focused on ending programs that should continue, continuing programs that should end, and reasons for endings.Results Among state health department employees, 36.5% reported that programs often or always end that should have continued, compared with 42.0% of respondents in local health departments and 38.3% of respondents working in other agencies. In contrast to ending programs that should have continued, 24.7% of state respondents reported programs often or always continuing when they should have ended, compared to 29.4% for local health departments and 25% of respondents working in other agencies. Certain reasons for program endings differed at the state versus local level (e.g., policy support, support from agency leadership), suggesting that actions to address mis-implementation are likely to vary.Conclusions The current data suggest a need to focus on mis-implementation in public health practice in order to make the best use of scarce resources.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many effective programs are discontinued prematurely and many ineffective ones continued when they should be terminated.
“And unfortunately many effective programs are discontinued prematurely and many ineffective ones continued when they should be terminated [73].”
From Social Network Analysis for Program Implementation (2015) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,909 · see citing works
Best Practices for Mixed Methods Research in Health Sciences
Creswell, J. W., Klassen, A. C., Clark, V. L. P., & Smith, K. C. (2011) · PsycEXTRA Dataset · doi:10.1037/e566732013-001 · Cited by 1,578 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Self-citationDissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355 · see citing works
Self-citationEvidence-Based Public Health: A Fundamental Concept for Public Health Practice
Brownson, R. C., Fielding, J. E., & Maylahn, C. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100134 · Cited by 1,138 · see citing works
Self-citationA Review of Collaborative Partnerships as a Strategy for Improving Community Health
Roussos, S. T., & Fawcett, S. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.369 · Cited by 1,134 · see citing works
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129 · see citing works
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775 · see citing works
Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.9.1394 · Cited by 655 · see citing works
Public health program capacity for sustainability: a new framework
Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-15 · Cited by 563 · see citing works
(2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195143768.001.0001 · Cited by 366 · see citing works
The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs
Luke, D. A., Calhoun, A., Robichaux, C. B., Elliott, M. B., & Moreland-Russell, S. (2014) · Preventing Chronic Disease · doi:10.5888/pcd11.130184 · Cited by 364 · see citing works
Project D.A.R.E. Outcome Effectiveness Revisited
West, S. L., & O’Neal, K. K. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.6.1027 · Cited by 356 · see citing works
The Merits of Mixing Methods in Evaluation
Greene, J. C., Benjamin, L. M., & Goodyear, L. K. (2001) · Evaluation · doi:10.1177/13563890122209504 · Cited by 255 · see citing works
Overuse of Health Care Services in the United States
Korenstein, D. R. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.772 · Cited by 236 · see citing works
Policy termination as a political process
Bardach, E. (1976) · Policy Sciences · doi:10.1007/bf00143910 · Cited by 224 · see citing works
Institutional and Economic Determinants of Public Health System Performance
Mays, G. P., McHugh, M., Shim, K., et al. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.064253 · Cited by 193 · see citing works
Community Capacity Building and Sustainability: Outcomes of Community-Based Participatory Research
Hacker, K. A., Tendulkar, S. A., Rideout, C., Bhuiya, N. S., Trinh‐Shevrin, C., Savage, C. P., Grullón, M., Strelnick, H., Leung, C., & DiGirolamo, A. M. (2012) · Progress in community health partnerships · doi:10.1353/cpr.2012.0048 · Cited by 184 · see citing works
Bauer, M. W., & Knill, C. (2014) · Journal of Comparative Policy Analysis: Research and Practice · doi:10.1080/13876988.2014.885186 · Cited by 182 · see citing works
Correlates of the Sustainability of Community-Based Heart Health Promotion Interventions
O’Loughlin, J. L., Rénaud, L., Richard, L., Gomez, L. S., & Paradis, G. (1998) · Preventive Medicine · doi:10.1006/pmed.1998.0348 · Cited by 175 · see citing works
Massatti, R. R., Sweeney, H. A., Panzano, P. C., & Roth, D. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0141-z · Cited by 153 · see citing works
Brownson, R. C., Baker, E. A., Left, T. L., Gillespie, K. N., & True, W. R. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195397895.001.0001 · Cited by 141 · see citing works
Self-citationRiding the Wave of Opportunity: Termination in Public Policy
Geva‐May, I. (2004) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muh020 · Cited by 112 · see citing works
What Lessons Have Been Learned From Other Attempts to Guide Social Change?
Economos, C. D., Brownson, R. C., DeAngelis, M. A., Foerster, S. B., Foreman, C. T., Gregson, J., Kumanyika, S., & Pate, R. R. (2009) · Nutrition Reviews · doi:10.1111/j.1753-4887.2001.tb06985.x · Cited by 112 · see citing works
Self-citationThe Influence of the VERB Campaign on Children's Physical Activity in 2002 to 2006
Huhman, M. E., Potter, L. D., Nolin, M. J., Piesse, A., Judkins, D. R., Banspach, S. W., & Wong, F. L. (2010) · American Journal of Public Health · doi:10.2105/ajph.2008.142968 · Cited by 111 · see citing works
Diel, L. B. (2007) · Ancient Mesoamerica · doi:10.1017/s0956536107000181 · Cited by 94 · see citing works
A Short-Term, Quasi-Experimental Evaluation of D.A.R.E.'s Revised Elementary School Curriculum
Vincus, A. A., Ringwalt, C., Harris, M. S., & Shamblen, S. R. (2010) · Journal of Drug Education · doi:10.2190/de.40.1.c · Cited by 68 · see citing works
Jacobs, J. A., Duggan, K., Erwin, P., Smith, C., Borawski, E., Compton, J., D’Ambrosio, L., Frank, S. H., Frazier-Kouassi, S., Hannon, P. A., et al. (2014) · Implementation Science · doi:10.1186/s13012-014-0124-x · Cited by 68 · see citing works
Self-citationTermination: Hard Choices-Harder Questions
Brewer, G. D. (1978) · Public Administration Review · doi:10.2307/975816 · Cited by 66 · see citing works
A dialogue. A model memorandum of collaboration: a proposal
Fawcett, S. B. (2000) · Public Health Reports · doi:10.1093/phr/115.2.174 · Cited by 63 · see citing works
Hauptman, P. J., Schnitzler, M. A., Swindle, J. P., & Burroughs, T. E. (2006) · JAMA · doi:10.1001/jama.296.15.1877 · Cited by 61 · see citing works
Understanding Administrative Evidence-Based Practices
Brownson, R. C., Reis, R. S., Allen, P. M., Duggan, K., Fields, R. P., Stamatakis, K. A., & Erwin, P. C. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.08.013 · Cited by 59 · see citing works
Self-citationAllen, P. M., Sequeira, S. M., Jacob, R. R., Hino, A. A. F., Stamatakis, K. A., Harris, J. K., Elliott, L., Kerner, J. F., Jones, E., Dobbins, M., et al. (2013) · Implementation Science · doi:10.1186/1748-5908-8-141 · Cited by 47 · see citing works
Self-citationBeatty, K., Harris, J. K., & Barnes, P. A. (2010) · The Journal of Rural Health · doi:10.1111/j.1748-0361.2010.00285.x · Cited by 46 · see citing works
Self-citationWong, F. L., Greenwell, M., Gates, S., & Berkowitz, J. M. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.03.003 · Cited by 32 · see citing works
Evidence-Based Public Health Practice Among Program Managers in Local Public Health Departments
Erwin, P. C., Harris, J. K., Smith, C. A., Leep, C. J., Duggan, K., & Brownson, R. C. (2013) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000027 · Cited by 27 · see citing works
Self-citationReassessing the concept of policy termination: the case of regional policy in England
Ferry, M., & Bachtler, J. (2013) · Policy Studies · doi:10.1080/01442872.2013.768389 · Cited by 25 · see citing works
Geva‐May, I. (2001) · International Journal of Public Administration · doi:10.1081/pad-100000448 · Cited by 24 · see citing works
Implementing Physical Activity Strategies
Pate, R. R., Names, & Büchner, D. M. (2013) · Cited by 24 · see citing works
Evaluation Fundamentals: Insights into Program Effectiveness, Quality, and Value
Fink, A. (2015) · Sage eBooks · doi:10.4135/9781483399232 · Cited by 23 · see citing works
Sarriot, E., Ricca, J., Ryan, L. J., Basnet, J., & Arscott‐Mills, S. (2009) · The International Journal of Health Planning and Management · doi:10.1002/hpm.1012 · Cited by 19 · see citing works
Bauman, A. E. (2004) · PubMed · Cited by 16 · see citing works
A Tool for Rating Chronic Disease Prevention and Public Health Interventions
Kelly, C., Scharff, D., LaRose, J., Dougherty, N. L., Hessel, A. S., & Brownson, R. C. (2013) · Preventing Chronic Disease · doi:10.5888/pcd10.130173 · Cited by 16 · see citing works
Academic Health Centers and Public Health Departments
Boex, J. R., Keck, C. W., Piatt, E. E., et al. (2006) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2005.08.044 · Cited by 15 · see citing works
Blackford, J., & Street, A. F. (2012) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2012.04179.x · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [23]Delaune J Everett W Waste and Inefficiency in the U.S. Health Care System--Clinical Care: A Comprehensive Analysis in Support of System-wide Improvements 2008 New England Healthcare Institute Cambridge, MA
- [24]Kohn L Corrigan J Donaldson M To Err Is Human: Building a Safer Health Care System 2000 National Academies Press Washington, DC 25077248
Cited by
Sorted by citations
Social Network Analysis for Program Implementation
Valente, T. W., Palinkas, L. A., Czaja, S., Chu, K.-H., & Brown, C. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0131712 · Cited by 332 · see citing works
Stoll, S., Janevic, M., Lara, M., Ramos-Valencia, G., Stephens, T. B., Persky, V., Uyeda, K., Ohadike, Y., & Malveaux, F. (2015) · Preventing Chronic Disease · doi:10.5888/pcd12.150133 · Cited by 32 · see citing works
- Authors
- Brownson, R. C., Allen, P., Jacob, R. R., Harris, J. K., Duggan, K., Hipp, P. R., & Erwin, P. C.
- Affiliations
- Washington University in St. Louis (US)
- Centene Corporation (United States) (US)
- University of Tennessee at Knoxville (US)
- Corresponding author
- Brownson, Ross C.
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2015-05
- Volume
- 48
- Issue
- 5
- Pages
- 543-551
- ISSN
- 0749-3797 (ISSN-L)
- PMC
- PMC4405656
- OpenAlex
- W2077382703
- Cited by
- 70
- References
- 47
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 8 · 2023: 12 · 2022: 9 · 2021: 9 · 2020: 10 · 2019: 4 · 2018: 6 · 2017: 3 · 2016: 1 · 2015: 2
- FWCI
- 7.29
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Cancer Institute (R01CA160327)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092950)
- National Center for Chronic Disease Prevention and Health Promotion (U48-DP-001903)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Public Health Policies and Education
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- MIS implementation, program termination, program continuation, state health departments, local health departments, public health workforce, policy support, leadership support, resource allocation, public health practice
- MeSH terms
- Adult, Cross-Sectional Studies, Female, Humans, Male, Middle Aged, United States, Public Health Practice, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review