Studying de-implementation in health: an analysis of funded research grants
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Studying de-implementation-defined herein as reducing or stopping the use of a health service or practice provided to patients by healthcare practitioners and systems-has gained traction in recent years. De-implementing ineffective, unproven, harmful, overused, inappropriate, and/or low-value health services and practices is important for mitigating patient harm, improving processes of care, and reducing healthcare costs. A better understanding of the state-of-the-science is needed to guide future objectives and funding initiatives. To this end, we characterized de-implementation research grants funded by the United States (US) National Institutes of Health (NIH) and the Agency for Healthcare Research and Quality (AHRQ). METHODS: We used systematic methods to search, identify, and describe de-implementation research grants funded across all 27 NIH Institutes and Centers (ICs) and AHRQ from fiscal year 2000 through 2017. Eleven key terms and three funding opportunity announcements were used to search for research grants in the NIH Query, View and Report (QVR) system. Two coders identified eligible grants based on inclusion/exclusion criteria. A codebook was developed, pilot tested, and revised before coding the full grant applications of the final sample. RESULTS: A total of 1277 grants were identified through the QVR system; 542 remained after removing duplicates. After the multistep eligibility assessment and review process, 20 grant applications were coded. Many grants were funded by NIH (n = 15), with fewer funded by AHRQ, and a majority were funded between fiscal years 2015 and 2016 (n = 11). Grant proposals focused on de-implementing a range of health services and practices (e.g., medications, therapies, screening tests) across various health areas (e.g., cancer, cardiovascular disease) and delivery settings (e.g., hospitals, nursing homes, schools). Grants proposed to use a variety of study designs and research methods (e.g., experimental, observational, mixed methods) to accomplish study aims. CONCLUSIONS: Based on the systematic portfolio analysis of NIH- and AHRQ-funded research grants over the past 17 years, relatively few have focused on studying the de-implementation of ineffective, unproven, harmful, overused, inappropriate, and/or low-value health services and practices provided to patients by healthcare practitioners and systems. Strategies for raising the profile and growing the field of research on de-implementation are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
The American Geriatrics Society 2012 Beers Criteria Update Expert Panel (2012) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2012.03923.x · Cited by 2,578
The Oregon Experiment — Effects of Medicaid on Clinical Outcomes
Baicker, K., Taubman, S. L., Allen, H. L., Bernstein, M., Gruber, J. H., Newhouse, J. P., Schneider, E. C., Wright, B. J., Zaslavsky, A. M., & Finkelstein, A. N. (2013) · New England Journal of Medicine · doi:10.1056/nejmsa1212321 · Cited by 1,150
Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices
Prasad, V., & Ioannidis, J. P. (2014) · Implementation Science · doi:10.1186/1748-5908-9-1 · Cited by 723 · cited 6×
“Codebook development and coding process The codebook was developed through an iterative process that included review of other NIH-specific portfolio Table 1 Search terms (n = 11), definition and/or key reference, and targeted funding opportunity announcements (FOA; n = 3) Search term Definition and/or key reference Ch…”
BackgroundMethodInfluentialGallagher, P., & O'Mahony, D. (2008) · Age and Ageing · doi:10.1093/ageing/afn197 · Cited by 697
Towards understanding the de-adoption of low-value clinical practices: a scoping review
Niven, D. J., Mrklas, K. J., Holodinsky, J. K., Straus, S. E., Hemmelgarn, B. R., Jeffs, L. P., & Stelfox, H. T. (2015) · BMC Medicine · doi:10.1186/s12916-015-0488-z · Cited by 369
McKibbon, K. A., Lokker, C., Wilczynski, N. L., Ciliska, D., Dobbins, M., Davis, D. A., Haynes, R. B., & Straus, S. E. (2010) · Implementation Science · doi:10.1186/1748-5908-5-16 · Cited by 345
2016 Update on Medical Overuse: A Systematic Review
Morgan, D. J., Dhruva, S. S., Wright, S. M., & Korenstein, D. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.5381 · Cited by 104
Neta, G., Sanchez, M. A., Chambers, D. A., Phillips, S. M., Leyva, B., Cynkin, L., Farrell, M. M., Heurtin-Roberts, S., & Vinson, C. (2015) · Implementation Science · doi:10.1186/s13012-014-0200-2 · Cited by 99
Self-citationPrasad, V. (2019) · doi:10.1353/book.49286 · Cited by 72
Cited by
The increasing value of eHealth in the delivery of patient-centred cancer care
Penedo, F. J., Oswald, L. B., Kronenfeld, J. P., Garcia, S. F., Cella, D., & Yanez, B. (2020) · The Lancet Oncology · doi:10.1016/s1470-2045(20)30021-8 · Cited by 252
Miller, C. J., Wiltsey‐Stirman, S., & Baumann, A. A. (2020) · Journal of Community Psychology · doi:10.1002/jcop.22279 · Cited by 138
Hagermoser Sanetti, L. M., & Collier-Meek, M. A. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.008 · Cited by 129
Navigating the field of implementation science towards maturity: challenges and opportunities
Chambers, D. A., & Emmons, K. M. (2024) · Implementation Science · doi:10.1186/s13012-024-01352-0 · Cited by 76
“Norton et al. [33] conducted a portfolio analysis of funded NIH and AHRQ grants focusing on de-implementation between 2000 and 2017.”
BackgroundSelf-citation
Metadata
- Authors
- Norton, W. E., Kennedy, A. E., & Chambers, D. A.
- Venue
- Implementation Science
- Published
- 2017-12
- Volume
- 12
- Issue
- 1
- Pages
- 144-144
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2771799627
- Cited by
- 100
- References
- 10
- FWCI
- 10.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Studying de-implementation in health: an analysis of funded research grants. https://app.cochat.ai/papers/10.1186/s13012-017-0655-z
- The paper
- Norton, W. E., Kennedy, A. E., & Chambers, D. A. (2017). Studying de-implementation in health: an analysis of funded research grants. Implementation Science. https://doi.org/10.1186/s13012-017-0655-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.