A Taxonomy for External Support for Practice Transformation
Open accessAbstract
BACKGROUND: There is no commonly accepted comprehensive framework for describing the practical specifics of external support for practice change. Our goal was to develop such a taxonomy that could be used by both external groups or researchers and health care leaders. METHODS: The leaders of 8 grants from Agency for Research and Quality for the EvidenceNOW study of improving cardiovascular preventive services in over 1500 primary care practices nationwide worked collaboratively over 18 months to develop descriptions of key domains that might comprehensively characterize any external support intervention. Combining literature reviews with our practical experiences in this initiative and past work, we aimed to define these domains and recommend measures for them. RESULTS: The taxonomy includes 1 domain to specify the conceptual model(s) on which an intervention is built and another to specify the types of support strategies used. Another 5 domains provide specifics about the dose/mode of that support, the types of change process and care process changes that are encouraged, and the degree to which the strategies are prescriptive and standardized. A model was created to illustrate how the domains fit together and how they would respond to practice needs and reactions. CONCLUSIONS: This taxonomy and its use in more consistently documenting and characterizing external support interventions should facilitate communication and synergies between 3 areas (quality improvement, practice change research, and implementation science) that have historically tended to work independently. The taxonomy was designed to be as useful for practices or health systems managing change as it is for research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The ERIC taxonomy has been widely adopted and further refined.
“The ERIC taxonomy has been widely adopted and further refined [6–13].”
From A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022 (2024) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
The Triple Aim: Care, Health, And Cost
Berwick, D. M., Nolan, T. W., & Whittington, J. (2008) · Health Affairs · doi:10.1377/hlthaff.27.3.759 · Cited by 5,136 · see citing works
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · see citing works
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447 · see citing works
Improving chronic illness care: translating evidence into action
Wagner, E. H., Austin, B. T., Davis, C., Hindmarsh, M., Schaefer, J., & Bonomi, A. (2001) · Health Affairs · doi:10.1377/hlthaff.20.6.64 · Cited by 3,446 · see citing works
Organizing Care for Patients with Chronic Illness
Wagner, E. H., Austin, B. T., & Korff, M. V. (1996) · The Milbank Quarterly · doi:10.2307/3350391 · Cited by 2,877 · see citing works
The Improvement Guide: A Practical Approach to Enhancing Organizational Performance
(1997) · Quality Management Journal · doi:10.1080/10686967.1998.11919154 · Cited by 2,876 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Continuous Improvement as an Ideal in Health Care
Berwick, D. M. (1989) · New England Journal of Medicine · doi:10.1056/nejm198901053200110 · Cited by 1,734 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355 · see citing works
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314 · see citing works
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223 · see citing works
Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108 · see citing works
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069 · see citing works
The improvement guide : a practical approach to enhancing organizational performance
Langley, G. J. (1996) · Jossey-Bass Publishers eBooks · Cited by 884 · see citing works
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711 · cited 1× · see citing works
“28 What each practice received was highly individualized for facilitator and practice preferences.”
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588 · see citing works
Large‐System Transformation in Health Care: A Realist Review
Best, A., Greenhalgh, T., Lewis, S. J., Saul, J. E., Carroll, S., & Bitz, J. (2012) · Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00670.x · Cited by 575 · see citing works
Systematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571 · see citing works
Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017) · Implementation Science · doi:10.1186/s13012-017-0657-x · Cited by 544 · see citing works
The 10 Building Blocks of High-Performing Primary Care
Bodenheimer, T., Ghorob, A., Willard‐Grace, R., & Grumbach, K. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1616 · Cited by 508 · see citing works
Transformational change in health care systems
Lukas, C. V., Holmes, S. K., COHEN, A. B., Restuccia, J. D., Cramer, I. E., Shwartz, M., & Charns, M. P. (2007) · Health Care Management Review · doi:10.1097/01.hmr.0000296785.29718.5d · Cited by 462 · see citing works
Lennox, L., Maher, L., & Reed, J. (2018) · Implementation Science · doi:10.1186/s13012-017-0707-4 · Cited by 421 · see citing works
Making Sense of Implementation Theories, Models, and Frameworks
Nilsén, P. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_3 · Cited by 343 · see citing works
Perry, C. K., Damschroder, L. J., Hemler, J. R., Woodson, T. T., Ono, S. S., & Cohen, D. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0876-4 · Cited by 288 · see citing works
Self-citationWhy (we think) facilitation works: insights from organizational learning theory
Berta, W., Cranley, L., Dearing, J. W., Dogherty, E. J., Squires, J. E., & Estabrooks, C. A. (2015) · Implementation Science · doi:10.1186/s13012-015-0323-0 · Cited by 286 · see citing works
Lomas, J., & Haynes, R. B. (1988) · PubMed · Cited by 220 · see citing works
Nutting, P. A., Crabtree, B. F., Stewart, E. E., Miller, W. L., Palmer, R. F., Stange, K. C., & Jaén, C. R. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1119 · Cited by 201 · see citing works
Self-citationColquhoun, H., Leeman, J., Michie, S., Lokker, C., Bragge, P., Hempel, S., McKibbon, K. A., Peters, G.-J. Y., Stevens, K. R., Wilson, M. G., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-51 · Cited by 180 · see citing works
Krause, J., van Lieshout, J., Klomp, R., Huntink, E. M., Aakhus, E., Flottorp, S. A., Jäger, C., Steinhaeuser, J., Godycki-Ćwirko, M., Kowalczyk, A., et al. (2014) · Implementation Science · doi:10.1186/s13012-014-0102-3 · Cited by 178 · see citing works
When Does Information Change Practitioners' Behavior?
Kanouse, D. E., & Jacoby, I. (1988) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300003214 · Cited by 148 · see citing works
A clinical trial of tailored office systems for preventive service delivery
Goodwin, M. A., Zyzanski, S. J., Zronek, S., Ruhe, M., Weyer, S. M., Konrad, N., Esola, D., & Stange, K. C. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00310-5 · Cited by 144 · see citing works
Powell, B. J., Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Barwick, M. A., Damschroder, L. J., Wensing, M., Wolfenden, L., & Lewis, C. C. (2017) · Implementation Science · doi:10.1186/s13012-017-0649-x · Cited by 144 · see citing works
Practice facilitators: a review of the literature.
Nagykaldi, Z. J., Mold, J. W., & ASPY, C. B. (2005) · PubMed · Cited by 143 · see citing works
Self-citationTricco, A. C., Ashoor, H. M., Cardoso, R., MacDonald, H. R., Cogo, E., Kastner, M., Perrier, L., McKibbon, A., Grimshaw, J., & Straus, S. E. (2015) · Implementation Science · doi:10.1186/s13012-016-0421-7 · Cited by 138 · see citing works
Improving Medical Practice: A Conceptual Framework
Solberg, L. I. (2007) · The Annals of Family Medicine · doi:10.1370/afm.666 · Cited by 124 · see citing works
Self-citationEdwards, S. T., Bitton, A., Hong, J., et al. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0351 · Cited by 108 · see citing works
Two-Year Costs and Quality in the Comprehensive Primary Care Initiative
Dale, S. B., Ghosh, A., Peikes, D. N., Day, T. J., Yoon, F. B., Taylor, E. F., Swankoski, K. E., O’Malley, A. S., Conway, P. H., Rajkumar, R., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmsa1414953 · Cited by 98 · see citing works
Solberg, L. I., Asche, S. E., Margolis, K. L., & Whitebird, R. R. (2008) · American Journal of Medical Quality · doi:10.1177/1062860608314942 · Cited by 90 · see citing works
Self-citationSolberg, L. I., Kottke, T. E., Brekke, M., Magnan, S. J., Davidson, G. B., Calomeni, C. A., Conn, S. A., Amundson, G. M., & Nelson, A. F. (2000) · PubMed · Cited by 89 · see citing works
Self-citationTransformation of Health Care at the Front Line
Conway, P. H. (2009) · JAMA · doi:10.1001/jama.2009.103 · Cited by 78 · see citing works
Dickinson, W. P., Dickinson, L. M., Nutting, P. A., Emsermann, C. B., Tutt, B., Crabtree, B. F., Fisher, L., Harbrecht, M. G., Gottsman, A., & West, D. R. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1591 · Cited by 77 · see citing works
Self-citationMold, J. W., Fox, C. H., Wisniewski, A., et al. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1624 · Cited by 73 · see citing works
Lokker, C., McKibbon, K. A., Colquhoun, H., & Hempel, S. (2015) · Implementation Science · doi:10.1186/s13012-015-0220-6 · Cited by 67 · see citing works
Holtrop, J. S., Rabin, B. A., & Glasgow, R. E. (2018) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2018.03.170259 · Cited by 64 · see citing works
Balasubramanian, B. A., Chase, S. M., Nutting, P. A., Cohen, D. J., Strickland, P. A. O., Crosson, J. C., Miller, W. L., Crabtree, B. F., & the ULTRA Study Team (2010) · The Annals of Family Medicine · doi:10.1370/afm.1159 · Cited by 60 · see citing works
Self-citationModel for Improvement - Part 1: A Framework for Health Care Quality
Courtlandt, C., Noonan, L. E., & Feld, L. G. (2009) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2009.06.002 · Cited by 59 · see citing works
Solberg, L. I., Glasgow, R. E., Unützer, J., Jaeckels, N., Oftedahl, G., Beck, A. L., Maciosek, M. V., & Crain, A. L. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181dbea62 · Cited by 58 · see citing works
Self-citationCohen, D. J., Balasubramanian, B. A., Gordon, L., Marino, M., Ono, S. S., Solberg, L. I., Crabtree, B. F., Stange, K. C., Davis, M. M., Miller, W. L., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0449-8 · Cited by 57 · see citing works
Self-citationWall of Silence, the Untold Story of the Medical Mistakes that Kill and Injure Millions of Americans
Gibson, R. H., & Singh, J. P. (2004) · Journal for Healthcare Quality · doi:10.1097/01445442-200403000-00016 · Cited by 50 · see citing works
EvidenceNOW: Balancing Primary Care Implementation and Implementation Research
Meyers, D. S., Miller, T., Genevro, J., Zhan, C., Mare, J. D. L., Fournier, A. K., Bennett, H., & McNellis, R. J. (2018) · The Annals of Family Medicine · doi:10.1370/afm.2196 · Cited by 40 · see citing works
Solberg, L. I., Kottke, T. E., Brekke, M. L., Magnan, S. J., Davidson, G. B., & Calomeni, C. A. (2000) · Cited by 39 · see citing works
Self-citationNagykaldi, Z. J., & Mold, J. W. (2007) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2007.02.060084 · Cited by 32 · see citing works
Self-citationState Innovation Model Initiative
Hughes, L. S., Peltz, A., & Conway, P. H. (2015) · JAMA · doi:10.1001/jama.2015.2017 · Cited by 19 · see citing works
Cykert, S., Lefebvre, A., Bacon, T., & Newton, W. P. (2016) · North Carolina Medical Journal · doi:10.18043/ncm.77.6.378 · Cited by 15 · see citing works
Self-citationMeasuring the Dose of Quality Improvement Initiatives
McHugh, M., Harvey, J., Kang, R. H., et al. (2015) · Medical Care Research and Review · doi:10.1177/1077558715603567 · Cited by 14 · see citing works
SASTRI, A. P., & Narayana, J. L. (2019) · INTERNATIONAL JOURNAL OF ADVANCED RESEARCH IN ENGINEERING & TECHNOLOGY · doi:10.34218/ijaret.10.1.2019.021 · Cited by 7 · see citing works
A Transformational Approach to Healthcare Quality Improvement
Silvey, A. B. (2004) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2004.tb00512.x · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [1]Berwick DM. Continuous improvement as an ideal in health care. N Engl J Med 1989; 320: 53– 6. 2909878
- [19]Powell BJ, Waltz TJ, Chinman MJ, A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015; 10: 21. 25889199 PMC4328074
- [27]Solberg LI, Glasgow RE, Unützer J, Partnership research: a practical trial design for evaluation of a natural experiment to improve depression care. Med Care 2010; 48: 576– 82. 20508531 PMC4270473
- [30]Lewis CC, Klasnja P, Powell BJ, From classification to causality: advancing understanding of mechanisms of change in implementation science. Front Public Health 2018; 6: 136. 29868544 PMC5949843
Cited by
Sorted by citations
Ashcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89 · see citing works
- Authors
- Solberg, L. I., Kuzel, A., Parchman, M. L., Shelley, D. R., Dickinson, W. P., Walunas, T. L., Nguyen, A. M., Fagnan, L. J., Cykert, S., Cohen, D. J., Balasubramanaian, B. A., Fernald, D., Gordon, L., Kho, A., Krist, A., Miller, W., Berry, C., Duffy, D., & Nagykaldi, Z.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- ORCID
- Venue
- The Journal of the American Board of Family Medicine
- Published
- 2021-01
- Volume
- 34
- Issue
- 1
- Pages
- 32-39
- ISSN
- 1557-2625 (ISSN-L)
- 1558-7118
- PMC
- PMC9190131
- OpenAlex
- W3119953308
- Cited by
- 18
- References
- 62
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 11 · 2023: 2 · 2022: 1 · 2021: 1
- FWCI
- 4.21
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- The Journal of the American Board of Family Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR002649)
- Agency for Healthcare Research and Quality (R18HS023912, R18 HS023908, R18 HS023913, R18 HS023904, R18 HS023919, R01 HS023940, R18 HS023922, R18HS023921)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- practice transformation, taxonomy (general classification scheme), quality improvement, implementation science, primary care practices
- MeSH terms
- Communication, Humans, Primary Health Care, Research Personnel, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review