Program sustainability: focus on organizational routines
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Program sustainability is an ongoing concern for most people in health promotion. However, the current notion of sustainability in organizations, namely routinization, needs refinement. This article examines organizational routines. In so doing, it refines the notion of sustainability and the assessment of routines. Drawing on the organizational literature, a routinized program is defined by the presence of routinized activities, meaning that these activities exhibit four characteristics of organizational routines: memory, adaptation, values and rules. To answer the question of how these characteristics are useful, we conducted an empirical study of the routinization of the Quebec Heart Health Demonstration Project in five community health centers. Our method consisted of a multiple-case study. We observed project activities in each center in 2000. The data came from documents and interviews with project actors. Our results show that, in one of the centers, no resources had been officially committed to project activities. Even so, the actors continued some activities on an informal basis. In another center, the activities satisfied three of the four routine characteristics. In the three others, activities satisfied all of the characteristics. These results suggest focusing the study of program sustainability on the routinization of activities resulting from it. They indicate four distinct degrees of sustainability: (1) the absence of sustainability; no program activity is continued; (2) precarious sustainability; some residual activities are pursued, at least unofficially; (3) weak sustainability; the program produces some official activities that are not routinized; and (4) sustainability through routinization; routinized activities result from the program.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hartley, J. (2004) · Essential Guide to Qualitative Methods in Organizational Research · doi:10.4135/9781446280119.n26 · Cited by 15,461
Organizational Learning: A Theory of Action Perspective
Argyris, C., & Schön, D. A. (1997) · Reis · doi:10.2307/40183951 · Cited by 11,113 · cited 2×
“The literature on organizational learning examines the evolution of routines and offers an authoritative framework to complete this definition (Argyris and Schön, 1978; Hedberg, 1981; Huber, 1996; Levitt and March, 1996; Weick, 1996; Edmondson and Moingeon, 1998; Argote, 1999).”
BackgroundOrganizational learning: The contributing processes and the literatures
Huber, G. P. (1991) · Organization Science · doi:10.1287/orsc.2.1.88 · Cited by 8,072 · cited 3×
“The literature on organizational learning examines the evolution of routines and offers an authoritative framework to complete this definition (Argyris and Schön, 1978; Hedberg, 1981; Huber, 1996; Levitt and March, 1996; Weick, 1996; Edmondson and Moingeon, 1998; Argote, 1999).”
BackgroundOrganizational Routines as a Source of Continuous Change
Feldman, M. S. (2000) · Organization Science · doi:10.1287/orsc.11.6.611.12529 · Cited by 1,969
Organizational routines are stored as procedural memory: Evidence from a laboratory study
Cohen, M. D., & Bacdayan, P. (1994) · Organization Science · doi:10.1287/orsc.5.4.554 · Cited by 1,393 · cited 2×
“Finally, routinized activities conform to rules governing decision-making and action (Cyert and March, 1970; Dogson, 1993; Cohen and Bacdayan, 1996; Hutchins, 1996).”
BackgroundMethodShediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129 · cited 3×
“The literature on health promotion provides several examples where no long-term activities were continued (Goodman and Steckler, 1988; Florin et al., 1992; Rissel et al., 1995; O’Loughlin et al., 1998; Shediac-Rizkallah and Bone, 1998; Wickizer et al., 1998; Lackey et al., 2000).”
BackgroundMaking public health programs last: conceptualizing sustainability
Pluye, P., Potvin, L., & Denis, J.-L. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.001 · Cited by 374 · cited 5×
“Like Goodman et al. (Goodman et al., 1993), we believe that the study of organizational routines plays a key role in the examination of program sustainability (Pluye et al., 2000; Pluye et al., 2004a).”
BackgroundInfluentialSelf-citationHow to Institutionalize Health Promotion Programs
Steckler, A., & Goodman, R. M. (1989) · American Journal of Health Promotion · doi:10.4278/0890-1171-3.4.34 · Cited by 146 · cited 3×
“The literature suggests that routinization is the primary or fundamental process in the sustainability of health promotion programs (Yin, 1979; Steckler and Goodman, 1989; Weber, 1995; Shediac-Rizkallah and Bone, 1998; Pluye et al., 2004a).”
Background
Cited by
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
“However, they did develop a 15-question interview to assess degrees of sustainability [41].”
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806
Developing a comprehensive definition of sustainability
Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0637-1 · Cited by 630
Making public health programs last: conceptualizing sustainability
Pluye, P., Potvin, L., & Denis, J.-L. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.001 · Cited by 374
Self-citationLégaré, F., Stacey, D., Gagnon, S., Dunn, S., Pluye, P., Frosch, D., Kryworuchko, J., Elwyn, G., Gagnon, M., & Graham, I. D. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01515.x · Cited by 259
Self-citationThe sustainability of healthcare innovations: a concept analysis
Fleiszer, A. R., Semenic, S. E., Ritchie, J. A., Richer, M., & Denis, J. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12633 · Cited by 166
Community Capacity Building and Sustainability: Outcomes of Community-Based Participatory Research
Hacker, K., Tendulkar, S. A., Rideout, C., Bhuiya, N., Trinh-Shevrin, C., Savage, C. P., Grullon, M., Strelnick, H., Leung, C., & DiGirolamo, A. (2012) · Progress in Community Health Partnerships: Research, Education, and Action · doi:10.1353/cpr.2012.0048 · Cited by 178
“11 Sustainability can also occur at multiple levels—the individual, organizational, and/or community level 12,13 —and involves programmatic “leverage” to influence outcomes.”
Program sustainability begins with the first events
Pluye, P., Potvin, L., Denis, J.-L., Pelletier, J., & Mannoni, C. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.10.003 · Cited by 147
Self-citationMeasuring persistence of implementation: QUERI Series
Initiative, T. H. Q. E. R., Bowman, C. C., Sobo, E. J., Asch, S. M., & Gifford, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-21 · Cited by 100
Sustainability of Social Programs: A Comparative Case Study Analysis
Savaya, R., Spiro, S., & Elran-Barak, R. (2008) · American Journal of Evaluation · doi:10.1177/1098214008325126 · Cited by 98
“Given the power and perseverance of institutional routines (Pluye et al., 2004a), it is viewed as important to adapt programs to the policies and regulations of the relevant government bodies (Sarriot et al., 2004) or, alternatively, to exert pressure to amend the policies to better accord with the…”
BackgroundDefining sustainability outcomes of health programs: Illustrations from an on-line survey
Scheirer, M. A., Hartling, G., & Hagerman, D. (2008) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2008.08.004 · Cited by 93
Advancing the pragmatic measurement of sustainment: a narrative review of measures
Moullin, J. C., Sklar, M., Green, A., Dickson, K. S., Stadnick, N. A., Reeder, K., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00068-8 · Cited by 72
Communicable disease control programmes and health systems: an analytical approach to sustainability
Shigayeva, A., & Coker, R. J. (2015) · Health Policy and Planning · doi:10.1093/heapol/czu005 · Cited by 63
Sustaining Change: Once Evidence-Based Practices Are Transferred, What Then?
Virani, T., Lemieux-Charles, L., Davis, D., & Berta, W. (2009) · Healthcare Quarterly · doi:10.12927/hcq.2009.20420 · Cited by 71
Conceptualizing and measuring sustainability of prevention programs, policies, and practices
Palinkas, L. A., Spear, S. E., Mendon, S. J., Villamar, J., Reynolds, C., Green, C. D., Olson, C., Adade, A., & Brown, C. H. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz170 · Cited by 66
Predictors of Sustainability of Social Programs
Savaya, R., & Spiro, S. E. (2012) · American Journal of Evaluation · doi:10.1177/1098214011408066 · Cited by 61
“Among the most widely used definitions are the continuation of the program (Pluye et al., 2004; Shediac-Rizkallah & Bone, 1998) and its institutionalization as an integral part of the organization (Goodman, Mcleroy, Seckler, & Hoyle, 1993; Goodson et al., 2001; O’Loughlin et al., 1998; Yin, 1979,…”
MethodProjected Sustainability of Innovative Social Programs
Savaya, R., Elsworth, G., & Rogers, P. (2009) · Evaluation Review · doi:10.1177/0193841x08322860 · Cited by 53
A theoretical framework to support research of health service innovation
Fox, A., Gardner, G., & Osborne, S. (2015) · Australian Health Review · doi:10.1071/ah14031 · Cited by 43
Klatt, M., Westrick, A., Bawa, R., Gabram, O., Blake, A., & Emerson, B. (2022) · EXPLORE · doi:10.1016/j.explore.2021.04.004 · Cited by 32
Francis, L., Dunt, D., & Cadilhac, D. A. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010944 · Cited by 24
“However, research providing evidence for effective sustainability strategies for health programmes is underdeveloped,(2) and clear recommendations to promote sustainability are limited.(3) Strengths and limitations of this study”
Background
Metadata
- Authors
- Pluye, P.
- Venue
- Health Promotion International
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-11-09
- Volume
- 19
- Issue
- 4
- Pages
- 489-500
- ISSN
- 0957-4824 (ISSN-L)
- 1460-2245
- OpenAlex
- W2143544460
- Cited by
- 144
- References
- 8
- FWCI
- 6.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.