The DOI matches its Crossref record; 27 of the 28 references it cites were found in a registry or an index.
Lessons from Experienced Guideline Implementers: Attend to Many Factors and Use Multiple Strategies
Abstract
Background Studies of clinical guideline implementation have focused almost entirely on changing individual clinician behavior with single intervention strategies and without much attention to the situational context. The goal of this project was to learn from clinic leaders, seasoned in the guideline implementation process, what contextual variables they viewed as important and whether implementation success could be expected if only a single implementation strategy was used.Methods In 1998, 12 people with extensive experience in leading clinical guideline implementation were identified who were thought to have particularly keen insight into the process. They were interviewed to generate variables they considered important, as well as strategies they considered effective when used appropriately. A modified nominal group/Delphi process was then used for rating these variables and strategies, and the reactions of international experts were obtained to add perspective to this information.Results Eighty-seven variables and 25 strategies were identified, clustering in 6 categories (ranked in order of importance by the panel): organizational capabilities for change, infrastructure for implementation, implementation strategies, medical group characteristics, guideline characteristics, and external environment. All six categories were considered to be important, key, or essential by the experienced implementers, although variables within a medical group that directly affect its ability to undertake planned change were rated as much more important than either guideline characteristics or the external environment.Discussion Although the opinions of those experienced in the process of guideline implementation are primarily of value for generating hypotheses, panel members believe that implementation efforts focusing on the individual physician with a single strategy are unlikely to be successful. Rather, implementation efforts must use multiple strategies that take account of multiple characteristics of the guideline, practice organization, and external environment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [99]
Citations
Cites
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,525
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
The Discovery of Grounded Theory: Strategies for Qualitative Research
Brodsky, C. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71872-7 · Cited by 6,728
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471
Hayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,771
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
(1997) · Europe PMC (PubMed Central) · Cited by 1,226
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877
A primer on leading the improvement of systems: Fig 1
Berwick, D. M. (1996) · BMJ · doi:10.1136/bmj.312.7031.619 · Cited by 793
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S. A., Russell, I. T., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · BMJ Quality & Safety · doi:10.1136/qshc.4.1.55 · Cited by 467
Grilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392
Systematic Reviews: Critical Links in the Great Chain of Evidence
Mulrow, C. D., Cook, D. J., & Davidoff, F. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00008 · Cited by 262
Understanding change in primary care practice using complexity theory.
Miller, W. L., Crabtree, B. F., McDaniel, R., & Stange, K. C. (1998) · PubMed · Cited by 233
Garside, P. (1998) · PubMed · Cited by 143
Primary care practice organization and preventive services delivery: a qualitative analysis.
Crabtree, B. F., Miller, W. L., Aita, V., Flocke, S. A., & Stange, K. C. (1998) · PubMed · Cited by 123
Implementing Clinical Practice Guidelines
Margolis, C. Z., & Cretin, S. (1998) · Cited by 110
Time for organisational development in healthcare organisations
Koeck, C. M. (1998) · BMJ · doi:10.1136/bmj.317.7168.1267 · Cited by 78
O’Connor, P. J., Solberg, L. I., Christianson, J. B., Amundson, G. H., & Mosser, G. (1996) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30274-7 · Cited by 59
Self-citationUsing practice genograms to understand and describe practice configurations.
McIlvain, H. E., Crabtree, B. F., Medder, J., Stange, K. C., & Miller, W. L. (1998) · PubMed · Cited by 50
Setting Priorities for Clinical Practice Guidelines
Institute of Medicine (1995) · National Academies Press eBooks · doi:10.17226/4959 · Cited by 49
Implementing clinical practice guidelines
Craft, P., Tait, N., & Buckingham, J. M. (2000) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2000.tb125582.x · Cited by 47
Mosser, G. (1996) · Quality Management in Health Care · doi:10.1097/00019514-199604040-00003 · Cited by 38
Self-citationOrganizational Tactics for the Successful Assimilation of Medical Practice Guidelines
Sonnad, S. S. (1998) · Health Care Management Review · doi:10.1097/00004010-199802330-00004 · Cited by 38
Primary Care, Process Improvement, and Turmoil
Magnan, S. J., Solberg, L. I., Giles, K., Kottke, T. E., & Wheeler, J. W. (1997) · Journal of Ambulatory Care Management · doi:10.1097/00004479-199710000-00006 · Cited by 31
Self-citationPalmer, R. H., & Hargraves, J. L. (1996) · Medical Care · doi:10.1097/00005650-199609002-00010 · Cited by 16
Assessing the Impact of Clinical Guidelines
Rolnick, S. J., & O’Connor, P. J. (1997) · Journal of Ambulatory Care Management · doi:10.1097/00004479-199710000-00008 · Cited by 10
Self-citationThe Contribution of Realism to Evaluation Research
Drewett, A. (1998) · Journal of Health Services Research & Policy · doi:10.1177/135581969800300411 · Cited by 1
Research works printed but not linked: 2
- 1999, Effective Health Care, 5, 1
- Lennarson Greer, 1995, Emerging themes in efforts to improve the quality of health care, Jt Comm J Qual Improv, 21, 319
Cited by
Sorted by citations
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Clinical Practice Guidelines We Can Trust
Board on Health Care Services (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,146
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
Feldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987
Metadata
- Authors
- Solberg, L. I., Brekke, M. L., Fazio, C. J., Fowles, J., Jacobsen, D. N., Kottke, T. E., Mosser, G., O’Connor, P. J., Ohnsorg, K. A., & Rolnick, S. J.
- Affiliations
- HealthPartners (US)
- Joint Commission (US)
- International Computer Science Institute (US)
- Mayo Clinic (US)
- Corresponding author
- Solberg, Leif I.
- Venue
- The Joint Commission Journal on Quality Improvement
- Publisher
- Elsevier BV
- Published
- 2000-04
- Volume
- 26
- Issue
- 4
- Pages
- 171-188
- ISSN
- 1070-3241 (ISSN-L)
- OpenAlex
- W2397003148
- Cited by
- 259
- References
- 28
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2022: 1 · 2021: 5 · 2020: 6 · 2019: 8 · 2018: 6 · 2017: 1 · 2016: 6 · 2015: 10 · 2014: 11 · 2013: 12 · 2012: 11
- FWCI
- 17.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Joint Commission Journal on Quality Improvement (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline implementation, implementation strategies, organizational infrastructure, external environment, clinician behavior change, expert consensus, Delphi method, nominal group technique
- MeSH terms
- Delphi Technique, Group Practice, Planning Techniques, Focus Groups, Practice Guidelines as Topic, Total Quality Management, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review