How do researchers conceptualize and plan for the sustainability of their NIH R01 implementation projects?
Open accessAbstract
BACKGROUND: Inadequate sustainability of implementation of evidence-based interventions has led to calls for research on how sustainability can be optimized. To advance our understanding of intervention sustainability, we explored how implementation researchers conceptualized and planned for the sustainability of their implemented interventions with studies funded by the United States (US) National Institutes of Health (NIH). METHODS: We used sequential, mixed methods to explore how researchers conceptualized and planned for the sustainability of the health interventions using (1) a document review of all active and completed US NIH R01 Grants and Equivalents reviewed within the Dissemination and Implementation Research in Health (DIRH) Study Section between 2004 and 2016 and (2) a qualitative content analysis of semi-structured interviews with NIH R01 DIRH grant recipients. RESULTS: We found 277 R01 profiles within the DIRH study section listed on the US NIH RePORTER website including 84 that were eligible for screening. Of the 84 unique projects, 76 (90.5%) had primary implementation outcomes. Of the 76 implementation project profiles, 51 (67.1%) made references to sustainability and none referred to sustainability planning. In both profiles and interviews, researchers conceptualized sustainability primarily as the continued delivery of interventions, programs, or implementation strategies. Few researchers referenced frameworks with sustainability constructs and offered limited information on how they operationalized frameworks. Researchers described broad categories of approaches and strategies to promote sustainability and key factors that may influence researchers to plan for sustainability, such as personal beliefs, self-efficacy, perception of their role, and the challenges of the grant funding system. CONCLUSIONS: We explored how US NIH R01 DIRH grant recipients conceptualized and planned for the sustainability of their interventions. Our results identified the need to test, consolidate, and provide guidance on how to operationalize sustainability frameworks, and to develop strategies on how funders and researchers can advance sustainability research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Use of frameworks to explicitly guide hypothesis formation is the minority, even within implementation efforts using theory to guide other aspects of the research process.
“Despite its explanatory power, use of frameworks to explicitly guide hypothesis formation are the minority, even within implementation efforts using theory to guide other aspects of the research process [38–40].”
From Ten recommendations for using implementation frameworks in research and practice (2020) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · see citing works
Achieving integration in mixed methods designs-principles and practices
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013) · Health Services Research · doi:10.1111/1475-6773.12117 · Cited by 5,772 · cited 1× · see citing works
“Qualitative and quantitative data from each phase were integrated narratively, and the results are presented using a contiguous approach [23].”
MethodMaking sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447 · see citing works
The SAGE Handbook of Qualitative Data Analysis
Flick, U. (2014) · doi:10.4135/9781446282243 · Cited by 2,469 · see citing works
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · see citing works
Self-citationA systematic review of the use of the Consolidated Framework for Implementation Research
Kirk, M. A., Kelley, C., Yankey, N., Birken, S. A., Abadie, B., & Damschroder, L. (2015) · Implementation Science · doi:10.1186/s13012-016-0437-z · Cited by 1,496 · see citing works
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710 · see citing works
Interventions to improve hand hygiene compliance in patient care
Gould, D. J., Moralejo, D. G., Drey, N., Chudleigh, J. H., & Taljaard, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005186.pub4 · Cited by 672 · see citing works
Developing a comprehensive definition of sustainability
Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0637-1 · Cited by 630 · see citing works
Self-citationBirken, S. A., Powell, B. J., Shea, C. M., Haines, E. R., Alexis Kirk, M., Leeman, J., Rohweder, C., Damschroder, L., & Presseau, J. (2017) · Implementation Science · doi:10.1186/s13012-017-0656-y · Cited by 471 · see citing works
Proctor, E., Luke, D., Calhoun, A., McMillen, C., Brownson, R., McCrary, S., & Padek, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0274-5 · Cited by 429 · see citing works
Lennox, L., Maher, L., & Reed, J. (2018) · Implementation Science · doi:10.1186/s13012-017-0707-4 · Cited by 421 · see citing works
Developing Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science
Glasgow, R. E., & Chambers, D. (2012) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00383.x · Cited by 278 · see citing works
Self-citationIwelunmor, J., Blackstone, S., Veira, D., Nwaozuru, U., Airhihenbuwa, C., Munodawafa, D., Kalipeni, E., Jutal, A., Shelley, D., & Ogedegbe, G. (2015) · Implementation Science · doi:10.1186/s13012-016-0392-8 · Cited by 219 · see citing works
Ament, S. M. C., de Groot, J. J. A., Maessen, J. M. C., Dirksen, C. D., van der Weijden, T., & Kleijnen, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008073 · Cited by 178 · see citing works
Dissemination and Implementation Research Funded by the US National Institutes of Health, 2005–2012
Tinkle, M. B., Kimball, R., Haozous, E. A., Shuster, G. F., & Meize‐Grochowski, R. (2013) · Nursing Research and Practice · doi:10.1155/2013/909606 · Cited by 79 · see citing works
Rankin, N. M., Butow, P. N., Thein, T., Robinson, T., Shaw, J., Price, M. A., Clover, K. A., Shaw, T. J., & Grimison, P. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0691-9 · Cited by 79 · see citing works
Chen, A. M. H., Yehle, K. S., Albert, N. M., Ferraro, K. F., Mason, H. L., Murawski, M. M., & Plake, K. S. I. (2013) · Nursing Research and Practice · doi:10.1155/2013/353290 · Cited by 75 · see citing works
Increasing the visibility of coding decisions in team-based qualitative research in nursing
Thompson, C. A., McCaughan, D., Cullum, N. A., Sheldon, T., & Raynor, P. (2003) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2003.03.001 · Cited by 70 · see citing works
Defining Program Sustainability: Differing Views of Stakeholders
Hanson, H. M., Salmoni, A. W., & Volpe, R. (2009) · Canadian Journal of Public Health · doi:10.1007/bf03403952 · Cited by 27 · see citing works
Savarit, E. (2020) · Apress eBooks · doi:10.1007/978-1-4842-5596-4_7 · Cited by 24 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [17]Dillman D Smyth J Christian L Internet, mail, and mixed-mode surveys 2009 3 Hoboken John Wiley & Sons, Inc
Cited by
Sorted by citations
Shelton, R. C., Chambers, D. A., & Glasgow, R. E. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00134 · Cited by 448 · see citing works
Self-citationTen recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488 · see citing works
Making change last? Exploring the value of sustainability approaches in healthcare: a scoping review
Lennox, L., Linwood-Amor, A., Maher, L., & Reed, J. E. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-00601-0 · Cited by 94 · see citing works
Navigating the field of implementation science towards maturity: challenges and opportunities
Chambers, D. A., & Emmons, K. M. (2024) · Implementation Science · doi:10.1186/s13012-024-01352-0 · Cited by 76 · see citing works
Self-citationAdvancing the pragmatic measurement of sustainment: a narrative review of measures
Moullin, J. C., Sklar, M., Green, A., Dickson, K. S., Stadnick, N. A., Reeder, K., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00068-8 · Cited by 72 · see citing works
Conceptualizing and measuring sustainability of prevention programs, policies, and practices
Palinkas, L. A., Spear, S. E., Mendon, S. J., Villamar, J., Reynolds, C., Green, C. D., Olson, C., Adade, A., & Brown, C. H. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz170 · Cited by 66 · see citing works
Berta, W. B., Wagg, A., Cranley, L. A., Doupe, M. B., Ginsburg, L. R., Hoben, M., MacEachern, L., Chamberlain, S. A., Clement, F. M., Easterbrook, A., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0959-2 · Cited by 53 · see citing works
Foraker, R. E., Benziger, C. P., DeBarmore, B. M., Cené, C. W., Loustalot, F. V., Khan, Y. M., Anderson, C. A. M., & Roger, V. L. (2020) · Circulation · doi:10.1161/cir.0000000000000913 · Cited by 46 · see citing works
Nevedal, A. L., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B., Gifford, A. L., Orvek, E., DeLaughter, K., White, L., King, H. A., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00053-1 · Cited by 44 · see citing works
PhD programs and the advancement of nursing science
Joseph, P. V., McCauley, L., & Richmond, T. S. (2020) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2020.06.011 · Cited by 28 · see citing works
Flynn, R., Mrklas, K., Campbell, A., Wasylak, T., & Scott, S. D. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07214-5 · Cited by 27 · see citing works
Nwaozuru, U., Murphy, P., Richard, A., Obiezu‐Umeh, C., Shato, T., Obionu, I. M., Gbaja-Biamila, T. A., Oladele, D. A., Mason, S., Takenaka, B. P., et al. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00716-x · Cited by 25 · see citing works
Ma, J., Hogan, M., Eyre, E. L. J., Lander, N., Barnett, L. M., & Duncan, M. J. (2020) · Journal of Sports Sciences · doi:10.1080/02640414.2020.1841395 · Cited by 20 · see citing works
Sustainability of an interprofessional collaborative practice model for population health
Shirey, M. R., Selleck, C. S., White-Williams, C., Talley, M., & Harper, D. C. (2020) · Nursing Administration Quarterly · doi:10.1097/naq.0000000000000429 · Cited by 19 · see citing works
Obesity prevention practices in early care and education settings: an adaptive implementation trial
Swindle, T., Rutledge, J. M., Selig, J. P., Painter, J. T., Zhang, D., Martin, J., Johnson, S. L., Whiteside-Mansell, L., Almirall, D., McElwee, T. M. B., et al. (2022) · Implementation Science · doi:10.1186/s13012-021-01185-1 · Cited by 15 · see citing works
Engelhart, A., Mason, S., Nwaozuru, U., Obiezu‐Umeh, C., Carter, V., Shato, T., Gbaja-Biamila, T. A., Oladele, D. A., & Iwelunmor, J. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.889390 · Cited by 16 · see citing works
Cobian, K. P., & Ramos, H. V. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02663-2 · Cited by 17 · see citing works
Iwelunmor, J., Tucker, J. D., Ezechi, O., Nwaozuru, U., Obiezu‐Umeh, C., Gbaja-Biamila, T. A., Oladele, D. A., Musa, A. Z., & Airhihenbuwa, C. O. (2023) · Current HIV/AIDS Reports · doi:10.1007/s11904-023-00652-2 · Cited by 12 · see citing works
The influence of healthcare financing on cardiovascular disease prevention in people living with HIV
Webel, A. R., Schexnayder, J. K., Rentrope, C. R., Bosworth, H. B., Hileman, C. O., Okeke, N. L., Vedanthan, R., & Longenecker, C. T. (2020) · BMC Public Health · doi:10.1186/s12889-020-09896-8 · Cited by 12 · see citing works
Hennessy, M., Heary, C., Laws, R., Rhoon, L. V., Toomey, E. C., Wolstenholme, H., & Byrne, M. (2019) · HRB Open Research · doi:10.12688/hrbopenres.12924.1 · Cited by 11 · see citing works
Hennessy, M., Heary, C., Laws, R., Rhoon, L. V., Toomey, E. C., Wolstenholme, H., & Byrne, M. (2019) · HRB Open Research · doi:10.12688/hrbopenres.12924.2 · Cited by 10 · see citing works
Reinforcing Feedbacks for Sustainable Implementation of Rural Drinking-Water Treatment Technology
Laauwen, M., & Nowicki, S. (2024) · ACS ES&T Water · doi:10.1021/acsestwater.3c00779 · Cited by 11 · see citing works
Nettlefold, L., MACDONALD, H. M., Sims‐Gould, J., Bauman, A. E., Szewczyk, Z., & McKay, H. A. (2024) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-024-01649-9 · Cited by 9 · see citing works
Chicoine, G., & Straus, S. E. (2025) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000496 · Cited by 7 · see citing works
Self-citationAging with Pride: Innovations in Dementia Empowerment and Action (IDEA)
Fredriksen‐Goldsen, K. I., Jones, B. R., Hoy‐Ellis, C. P., Kim, H., Emlet, C. A., LaFazia, D. M., McKenzie, G. L., Petros, R., & Teri, L. L. (2023) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2023.101169 · Cited by 7 · see citing works
Nørgaard, B., Romero, C. S., Bała, M. M., Lund, H., & Andreasen, J. (2025) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2025.102660 · Cited by 5 · see citing works
Reszel, J., Daub, O., Leese, J., Augustsson, H., Bellows, D. M., Cassidy, C. E., Crowner, B. E., Dunn, S., Goodwin, L. B., Hoens, A. M., et al. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00525-0 · Cited by 5 · see citing works
Self-citationCassidy, C. E., Flynn, R., Campbell, A., Dobson, L., Langley, J. E., McNeil, D. A., Milne, E., Zanoni, P., Churchill, M., & Benzies, K. (2024) · BMC Nursing · doi:10.1186/s12912-024-01777-4 · Cited by 4 · see citing works
Sustainability of a Child Mental Health Intervention in Child Welfare Services: Case study
Pisciotta, C., Hill-Kane, R., Winters, A. M., Hooley, C., Lee, K. A., Green, T., & Gopalan, G. (2023) · Medical Research Archives · doi:10.18103/mra.v11i10.4524 · Cited by 2 · see citing works
Chambers, D. A., & Goddard, K. A. B. (2024) · Public Health Genomics · doi:10.1159/000541577 · Cited by 2 · see citing works
Self-citationObiezu‐Umeh, C., Subramaniam, D. S., Nwaozuru, U., Gbaja-Biamila, T. A., Blessing, L. A., Shato, T., Oladele, D. A., Hirschhorn, L. R., Shacham, E., Xian, H., et al. (2025) · Frontiers in Health Services · doi:10.3389/frhs.2025.1618400 · Cited by 2 · see citing works
Mavropoulou, S. (2019) · Springer eBooks · doi:10.1007/978-981-13-5962-0_6 · Cited by 2 · see citing works
Moreland‐Russell, S., Jost, E., & Gannon, J. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2023.1026484 · Cited by 5 · see citing works
Cobian, K. P., & Ramos, H. V. (2021) · Research Square · doi:10.21203/rs.3.rs-189320/v1 · Cited by 2 · see citing works
Thinking Like an Implementation Scientist and Applying Your Research in Practice
Graham, A. K. (2022) · Springer eBooks · doi:10.1007/978-3-031-10754-2_21
Changing patterns of routine laboratory testing over time at children's hospitals
Tchou, M. J., Hall, M., Markham, J. L., Stephens, J. R., Steiner, M. J., McCoy, E., Aronson, P. L., Shah, S. S., Molloy, M. J., & Cotter, J. M. (2024) · Journal of Hospital Medicine · doi:10.1002/jhm.13372
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610079
Cassidy, C. E., Flynn, R., Campbell, A., Dobson, L., Langley, J. E., McNeil, D. A., Milne, E., Zanoni, P., Churchill, M., & Benzies, K. (2024) · Figshare · doi:10.6084/m9.figshare.25239406
Lennox, L., Linwood-Amor, A., Maher, L., & Reed, J. (2020) · Figshare · doi:10.6084/m9.figshare.13088038
Reszel, J., Daub, O., Leese, J., Augustsson, H., Bellows, D. M., Cassidy, C. E., Crowner, B. E., Dunn, S., Goodwin, L. B., Hoens, A. M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26645662
Self-citationNevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610073
Webel, A. R., Schexnayder, J. K., Rentrope, C. R., Bosworth, H. B., Hileman, C. O., Okeke, N. L., Vedanthan, R., & Longenecker, C. T. (2020) · Figshare · doi:10.6084/m9.figshare.13278861
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610085
Reszel, J., Daub, O., Leese, J., Augustsson, H., Bellows, D. M., Cassidy, C. E., Crowner, B. E., Dunn, S., Goodwin, L. B., Hoens, A. M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26645665
Self-citationLennox, L., Linwood-Amor, A., Maher, L., & Reed, J. (2020) · Figshare · doi:10.6084/m9.figshare.13088032
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610082
Lennox, L., Linwood-Amor, A., Maher, L., & Reed, J. (2020) · Figshare · doi:10.6084/m9.figshare.13088035
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610076
Shelton, R. C., & Sichel, C. E. (2026) · Implementation Science · doi:10.1186/s13012-026-01495-2
Osińska, M., Braun, D., Baumann, S., Benkert, B., Curreri, N. A., Huang, J., Simon, M., Grootven, B. V., & Zúñiga, F. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1796984
Nilsagård, Y. E., & Nilsing‐Strid, E. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-15103-y
Swindle, T., Rutledge, J. M., Rushing, T., Zhang, D., & Curran, G. M. (2026) · Implementation Science · doi:10.1186/s13012-026-01537-9
Siam, A., Onat, N. C., Shaaban, K. S., Naeem, K., & Küçükvar, M. (2026) · International Journal of Sustainable Transportation · doi:10.1080/15568318.2026.2749528
- Authors
- Johnson, A. M., Moore, J. E., Chambers, D. A., Rup, J., Dinyarian, C., & Straus, S. E.
- Affiliations
- St. Michael's Hospital (CA)
- National Institutes of Health (US)
- Corresponding author
- Straus, Sharon E.
- Venue
- Implementation Science
- Published
- 2019-05-09
- Volume
- 14
- Issue
- 1
- Pages
- 50-50
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC6506963
- OpenAlex
- W2946928234
- Cited by
- 53
- References
- 23
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 9 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 19 · 2019: 5
- FWCI
- 10.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TSpace (University of Toronto) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Keywords
- intervention sustainability, sustainability planning, implementation research, NIH R01 grants, dissemination and implementation research, research funding, sustainability framework, evidence-based interventions, grant recipients
- MeSH terms
- Implementation Science, Financing, Organized, Humans, Interviews as Topic, National Institutes of Health (U.S.), Planning Techniques, Research Personnel, United States
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review