Development of Level of Institutionalization Scales for Health Promotion Programs
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
This study was conducted to test an instrument for measuring the level of institutionalization (LoIn) of health promotion programs. Institutionalization occurs when a program becomes an integral part of an organization, and the LoIn instrument is a beginning effort to measure the extent of program integration into organizations. The instrument is based on theory that holds that organizations are composed of production, maintenance, supportive, and managerial subsystems. Institutionalization occurs when a program becomes imbedded into these subsystems. A questionnaire designed to test this construct was mailed to 453 administrators in 141 organizations that operate health promotion programs. Based on 322 usable responses (71%), a confirmatory factor analysis was conducted. The results support the hypothesis of an eight-factor model: four factors concern how routinized the program was in each subsystem and four factors concern the degree of program saturation within each subsystem. Correlations of the eight factors with the number of years the programs had been in operation, and managers' perceptions of program permanency, indicated that the four routinization factors were more highly correlated with program longevity than the four niche saturation factors, and the niche saturation factors were more highly correlated with managers' perceptions of program permanence than the routinization factors. The instrument, which is available from the authors, may be used as both a research instrument and a diagnostic tool in assessing the institutionalization of health promotion programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An ecological perspective on health promotion programs
McLeroy, K. R., Bibeau, D., Steckler, A., & Glanz, K. (1988) · Health Education Quarterly · doi:10.1177/109019818801500401 · Cited by 8,502
Self-citationReliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Factor-analytic methods of scale development in personality and clinical psychology
Comrey, A. L. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.5.754 · Cited by 1,154
A model for the institutionalization of health promotion programs
Goodman, R. M., & Steckler, A. (1989) · Family & Community Health · doi:10.1097/00003727-198902000-00009 · Cited by 224
Self-citationHow to Institutionalize Health Promotion Programs
Steckler, A., & Goodman, R. M. (1989) · American Journal of Health Promotion · doi:10.4278/0890-1171-3.4.34 · Cited by 146
Self-citation
Cited by
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775
“organization changes its practices, procedures, and policies within its operations and structure can be an important reflection of degree of program institutionalization.(5) Yet sustained change in organizational policies or procedures could be an important outcome in itself, whether or not other program activities re…”
BackgroundIs Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710
“Only a few of the studies reviewed here discussed in any detail their own operational definitions of sustainability, a notable exception being the careful work by Goodman and his colleagues on the institutionalization of a program (Goodman & Steckler, 1989; Goodman et al., 1993; Steckler & Goodman, 1989).”
BackgroundDeveloping a comprehensive definition of sustainability
Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0637-1 · Cited by 630
Does the Chronic Care Model Serve Also as a Template for Improving Prevention?
Glasgow, R. E., Tracy Orleans, C., Wagner, E. H., Curry, S. J., & Solberg, L. I. (2001) · The Milbank Quarterly · doi:10.1111/1468-0009.00222 · Cited by 446
Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015) · Implementation Science · doi:10.1186/s13012-015-0342-x · Cited by 430
“Only one instrument identified in our review—the Levels of Institutionalization Scales for Health Promotion Programs [13]—had information available for all six EBA rating criteria.”
InfluentialLennox, L., Maher, L., & Reed, J. (2018) · Implementation Science · doi:10.1186/s13012-017-0707-4 · Cited by 421
“[85] 1993 Level of Institutionalisation (LoIn) Scale To measure the extent of programme integration into an organisation”
MethodBuilding capacity and sustainable prevention innovations: a sustainability planning model
Johnson, K., Hays, C., Center, H., & Daley, C. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.002 · Cited by 411
Making public health programs last: conceptualizing sustainability
Pluye, P., Potvin, L., & Denis, J.-L. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.001 · Cited by 374
“Fourth, discontinued community programs bring disillusion to participants and therefore pose obstacles to subsequent community mobilization (Goodman et al., 1993; Shediac-Rizkallah & Bone, 1998).”
BackgroundInfluentialMultiplying Health Gains: the critical role of capacity-building within health promotion programs
Hawe, P., Noort, M., King, L., & Jordens, C. (1997) · Health Policy · doi:10.1016/s0168-8510(96)00847-0 · Cited by 366
Klesges, L. M., Estabrooks, P. A., Dzewaltowski, D. A., Bull, S. S., & Glasgow, R. E. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2902s_10 · Cited by 324
Sustaining Community‐Based Programs for Families: Conceptualization and Measurement*
Mancini, J. A., & Marek, L. I. (2004) · Family Relations · doi:10.1111/j.0197-6664.2004.00040.x · Cited by 199
The effectiveness of champions in implementing innovations in health care: a systematic review
Santos, W. J., Graham, I. D., Lalonde, M., Demery Varin, M., & Squires, J. E. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00315-0 · Cited by 205
The sustainability of healthcare innovations: a concept analysis
Fleiszer, A. R., Semenic, S. E., Ritchie, J. A., Richer, M., & Denis, J. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12633 · Cited by 166
Measuring implementation outcomes: An updated systematic review of measures’ psychometric properties
Mettert, K., Lewis, C., Dorsey, C., Halko, H., & Weiner, B. (2020) · Implementation Research and Practice · doi:10.1177/2633489520936644 · Cited by 162
Linking Sustainability Research to Intervention Types
Scheirer, M. A. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.300976 · Cited by 161
Braithwaite, J., Ludlow, K., Testa, L., Herkes, J., Augustsson, H., Lamprell, G., McPherson, E., & Zurynski, Y. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036453 · Cited by 147
Aarons, G. A., Green, A. E., Willging, C. E., Ehrhart, M. G., Roesch, S. C., Hecht, D. B., & Chaffin, M. J. (2014) · Implementation Science · doi:10.1186/s13012-014-0183-z · Cited by 107
Supply chain innovation diffusion: Going beyond adoption
Hazen, B. T., Overstreet, R. E., & Cegielski, C. G. (2012) · The International Journal of Logistics Management · doi:10.1108/09574091211226957 · Cited by 117
Measuring persistence of implementation: QUERI Series
Initiative, T. H. Q. E. R., Bowman, C. C., Sobo, E. J., Asch, S. M., & Gifford, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-21 · Cited by 100
Sustainability of Social Programs: A Comparative Case Study Analysis
Savaya, R., Spiro, S., & Elran-Barak, R. (2008) · American Journal of Evaluation · doi:10.1177/1098214008325126 · Cited by 98
“The finding that the sustainability is not an either/or matter but exists along a continuum is consistent with the definitions of sustainability provided by previous scholars (e.g., Goodman et al., 1993; O’Loughlin et al., 1998; Shediac-Rizkallah & Bone, 1998).”
ResultDefining sustainability outcomes of health programs: Illustrations from an on-line survey
Scheirer, M. A., Hartling, G., & Hagerman, D. (2008) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2008.08.004 · Cited by 93
Hall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01252-1 · Cited by 81
“Only the seven sub-scales assessing determinants of sustainability are assessed here Measure Outer context Inner context Intervention characteristics Processes Implementation and population characteristics Assessment of Barriers to Implementation and Sustainability in Schools (ABISS) [36] No Yes No No Yes Advanced Lev…”
Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2017) · Implementation Science · doi:10.1186/s13012-017-0606-8 · Cited by 56
Advancing the pragmatic measurement of sustainment: a narrative review of measures
Moullin, J. C., Sklar, M., Green, A., Dickson, K. S., Stadnick, N. A., Reeder, K., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00068-8 · Cited by 72
Communicable disease control programmes and health systems: an analytical approach to sustainability
Shigayeva, A., & Coker, R. J. (2015) · Health Policy and Planning · doi:10.1093/heapol/czu005 · Cited by 63
A framework and a measurement instrument for sustainability of work practices in long-term care
Slaghuis, S. S., Strating, M. M., Bal, R. A., & Nieboer, A. P. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-314 · Cited by 71
“This is institutionalization, understood as the gradual adaptation of the organizational context, including structures and processes, to the new work practice [6,7,11-13].”
BackgroundPredictors of Sustainability of Social Programs
Savaya, R., & Spiro, S. E. (2012) · American Journal of Evaluation · doi:10.1177/1098214011408066 · Cited by 61
Lennox, L., Doyle, C., Reed, J. E., & Bell, D. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014417 · Cited by 59
Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2015) · Implementation Science · doi:10.1186/s13012-015-0364-4 · Cited by 58
“These findings are consistent with previous theories that suggest that existing infrastructure, such as the intervention being consistent with the overall mission of the organization, is key to adoption, implementation and sustainment [45, 20, 19].”
ResultProjected Sustainability of Innovative Social Programs
Savaya, R., Elsworth, G., & Rogers, P. (2009) · Evaluation Review · doi:10.1177/0193841x08322860 · Cited by 53
Critical Measurement Issues in Translational Research
Glasgow, R. E. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335497 · Cited by 42
Hanh, T. T. T., Hill, P. S., Kay, B. H., & Quy, T. M. (2009) · The American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2009.80.312 · Cited by 32
Villablanca, A. C., Warford, C., & Wheeler, K. (2016) · Journal of Women's Health · doi:10.1089/jwh.2014.5109 · Cited by 23
“Sustainability, the process in which a program becomes an integral part of an established organization, affords the greatest prospects of sustainability.(49,50) Our program was successfully sustained over 4 months via continuous engagement with site leaders, participant rewards, and interval sharing of results and suc…”
Metadata
- Authors
- Goodman, R. M., McLeroy, K. R., Steckler, A. B., & Hoyle, R. H.
- Venue
- Health Education Quarterly
- Publisher
- SAGE Publications
- Published
- 1993-07
- Volume
- 20
- Issue
- 2
- Pages
- 161-178
- ISSN
- 0195-8402 (ISSN-L)
- OpenAlex
- W2054759526
- Cited by
- 181
- References
- 5
- FWCI
- 3.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.