The DOI matches its Crossref record; 27 of the 28 references it cites were found in a registry or an index.
Lessons from Experienced Guideline Implementers: Attend to Many Factors and Use Multiple Strategies
Abstract
Background Studies of clinical guideline implementation have focused almost entirely on changing individual clinician behavior with single intervention strategies and without much attention to the situational context. The goal of this project was to learn from clinic leaders, seasoned in the guideline implementation process, what contextual variables they viewed as important and whether implementation success could be expected if only a single implementation strategy was used.Methods In 1998, 12 people with extensive experience in leading clinical guideline implementation were identified who were thought to have particularly keen insight into the process. They were interviewed to generate variables they considered important, as well as strategies they considered effective when used appropriately. A modified nominal group/Delphi process was then used for rating these variables and strategies, and the reactions of international experts were obtained to add perspective to this information.Results Eighty-seven variables and 25 strategies were identified, clustering in 6 categories (ranked in order of importance by the panel): organizational capabilities for change, infrastructure for implementation, implementation strategies, medical group characteristics, guideline characteristics, and external environment. All six categories were considered to be important, key, or essential by the experienced implementers, although variables within a medical group that directly affect its ability to undertake planned change were rated as much more important than either guideline characteristics or the external environment.Discussion Although the opinions of those experienced in the process of guideline implementation are primarily of value for generating hypotheses, panel members believe that implementation efforts focusing on the individual physician with a single strategy are unlikely to be successful. Rather, implementation efforts must use multiple strategies that take account of multiple characteristics of the guideline, practice organization, and external environment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [99]
Citations
Cites
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,525
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
The Discovery of Grounded Theory: Strategies for Qualitative Research
Brodsky, C. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71872-7 · Cited by 6,728
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471
Hayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,771
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
(1997) · Europe PMC (PubMed Central) · Cited by 1,226
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877
A primer on leading the improvement of systems: Fig 1
Berwick, D. M. (1996) · BMJ · doi:10.1136/bmj.312.7031.619 · Cited by 793
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S. A., Russell, I. T., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · BMJ Quality & Safety · doi:10.1136/qshc.4.1.55 · Cited by 467
Research works printed but not linked: 2
- 1999, Effective Health Care, 5, 1
- Lennarson Greer, 1995, Emerging themes in efforts to improve the quality of health care, Jt Comm J Qual Improv, 21, 319
Cited by
Sorted by citations
Items 201–259 of 259
Organizational factors that support the implementation of a nursing Best Practice Guideline
Marchionni, C., & Ritchie, J. A. (2007) · Journal of Nursing Management · doi:10.1111/j.1365-2934.2007.00775.x · Cited by 7
Improving clinical practice: what works and what doesn’t?
Campbell, D. A., Scott, I. A., Anderson, J., & Greenberg, P. (2001) · Internal Medicine Journal · doi:10.1046/j.1445-5994.2001.00126.x · Cited by 7
Factors That Encourage or Discourage Doctors from Acting in Accordance with Good Practice
Scraggs, E., Brereton, L., Newbould, J., Drabble, S., Schweppenstedde, D., Miani, C., & Ling, T. (2012) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 7
Contextual Influences and Strategies for Dissemination and Implementation in Mental Health
Benjamin Wolk, C., Powell, B. J., & Beidas, R. S. (2015) · Oxford Handbook Topics in Psychology · doi:10.1093/oxfordhb/9780199935291.013.12 · Cited by 6
Improving the Quality of Dementia Care: The Role of Education
Mittman, B. S. (2006) · Clinical Gerontologist · doi:10.1300/j018v29n02_07 · Cited by 6
Birken, S. A. (2011) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/6nnn-gs48 · Cited by 6
Araújo, M., Alvarez, M., & Godinho, C. I. A. (2020) · PubMed · Cited by 6
Henderson, A. J., Davies, J., & Willet, M. R. (2006) · Australian Health Review · doi:10.1071/ah060474 · Cited by 7
Clinicians and guidelines: leading a horse to water ...
Jackson, C. L., & de Jong, I. C. (2001) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2001.tb143265.x · Cited by 6
Organizational and cultural change considerations
Ash, J. S. (2007) · Elsevier eBooks · doi:10.1016/b978-012369377-8/50019-2 · Cited by 5
LEAP--A Brief Intervention to Improve Activity and Diet: A Report From CaReNet and HPRN
Quintela, J. (2005) · The Annals of Family Medicine · doi:10.1370/afm365 · Cited by 5
The Patient-Centered Medical Home
Rakel, D. P., & Jonas, W. B. (2011) · Elsevier eBooks · doi:10.1016/b978-1-4377-1160-8.10002-8 · Cited by 5
Gatej, A.-R., Lamers, A., van Domburgh, L., & Vermeiren, R. R. J. M. (2019) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-019-01365-x · Cited by 5
Dupont, C., Touzet, S., Cao, D., Prunaret-Julien, V., Audra, P., Putet, G., Dupuis, O., & Rudigoz, R.-C. (2005) · Journal de gynécologie, obstétrique et biologie de la reproduction. Supplément/Journal de gynécologie obstétrique et biologie de la reproduction · doi:10.1016/s0368-2315(05)82884-4 · Cited by 5
Rowe, R., & McDaid, D. (2007) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2006.08.002 · Cited by 5
Comparing Physician and Administrator Responses to Cesarean Section Guidelines and Actual Practice
Sonnad, S. S., Moyer, C. A., & Bernstein, S. J. (2000) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(00)26043-4 · Cited by 5
Weintraub, W. S. (2006) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.12.013 · Cited by 5
Stergiou‐Kita, M., Grigorovich, A., DAWSON, D. R., Bottari, C. L., & Hébert, D. (2016) · British Journal of Occupational Therapy · doi:10.1177/0308022616631759 · Cited by 4
Impact de recommandations locales sur la qualité de l’antibiothérapie dans l’infection urinaire
Arnaud, I., Kouri, D. E., Nguyen, J., Foucher, Y., Karam, G., Lepage, J.-Y., Billard, M., Potel, G., & Lombrail, P. (2005) · La Presse Médicale · doi:10.1016/s0755-4982(05)84253-8 · Cited by 4
Ellen, M., Baker, G. R., & Brown, A. D. (2014) · Journal of Hospital Administration · doi:10.5430/jha.v3n4p25 · Cited by 4
Garnick, D. W., Horgan, C. M., Merrick, E. L., Hodgkin, D., Faulkner, D., & Bryson, S. (2002) · PubMed · Cited by 4
The QUEST for Quality: What Are Medical Groups Doing About It?
Solberg, L. I., O’Connor, P. J., Christianson, J. B., Whitebird, R. R., Rush, W. A., Amundson, G. M., & Asche, S. E. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31027-0 · Cited by 4
Self-citationVirtual versus in-person meetings for practice guideline panels: A qualitative study
Zouhbi, A. E., Assaf, L., Honein-AbouHaidar, G. N., Khabsa, J., & Akl, E. A. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111974 · Cited by 3
Hl, B., Franqui-Rivera, H., Segarra-Alonso, O., Gonzalez-Mercado, V. J., Altieri-Nieto, P. I., Calderón-Rodríguez, R., & Vélez-Crespo, M. (2008) · PubMed · Cited by 3
Digital Competency's Role in Promoting Equity in the Digital Healthcare Ecosystem
Abubakari, M. S., & Abdulwahab, L. O. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-3531-5.ch005 · Cited by 2
Lane, J., Archambault, J., & Bazinet, J. (2012) · Les Presses de l'Université de Montréal eBooks · doi:10.4000/books.pum.8797 · Cited by 2
Bearman, S. K., Rohde, P., Pauling, S., Gau, J. M., Shaw, H. E., & Stice, E. M. (2024) · Implementation Science · doi:10.1186/s13012-024-01373-9 · Cited by 4
Revisiting the Educationally Influential Physician: Development of a Simplified Nomination Form
Karwoski, J. B. (2012) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20133 · Cited by 2
Implementing an Evidence-based Hypertension Guideline into Finnish Primary Care Nursing
Alanen, S. (2009) · UTUPub (University of Turku) · Cited by 2
Two kinds of knowledge to achieve better care
Headrick, L. A. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.00720.x · Cited by 2
Value in development of complex interventions.
Sales, A. E., & Helfrich, C. D. (2006) · PubMed · Cited by 2
Mischler, M. J., & Hanks, J. R. (2015) · Springer eBooks · doi:10.1007/978-3-319-23329-1_8 · Cited by 1
Implementation of Evidence-Based Care
Daniels, P. A., & Capouya, J. D. (2017) · Springer eBooks · doi:10.1007/978-3-319-53790-0_9 · Cited by 1
Sloane, J., Singh, H., Upadhyay, D. K., Korukonda, S., Marinez, A., & Giardina, T. D. (2024) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2024.05.011 · Cited by 1
Powell, B. J. (2014) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7571943 · Cited by 1
Dykeman, S., Williams, A., & Crooks, V. A. (2013) · Qualitative Social Work · doi:10.1177/1473325013491447 · Cited by 1
Quality Improvement in Respiratory Care
Payne, N. R. (2010) · Elsevier eBooks · doi:10.1016/b978-1-4160-5624-9.00019-6 · Cited by 1
Organizational and Cultural Change
Ash, J. S., & Hartzog, T. H. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398476-0.00023-3 · Cited by 1
Jiménez, J. P., & Botto, A. (2021) · Depression and personality · doi:10.1007/978-3-030-77329-8_16 · Cited by 1
Dew-Reeves, S. E. (2008) · Europe PMC (PubMed Central) · Cited by 1
Baskerville, N. B. (2009) · UWSpace (University of Waterloo) · Cited by 1
Smeets, H. M. (2009) · Utrecht University Repository (Utrecht University)
Työn piirteet ja hoitosuositusasenteet terveydenhuollon ammattilaisilla
KORHONEN, H. (2009) · Tampere University Institutional Repository (Tampere University)
Implementing Traumatic Cervical Spine Clearance Clinical Practice Guidelines
Linskey, M. E. (2010) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e3181dc999b
Sipilä, R. (2012) · Työväentutkimus Vuosikirja
Implementation of antibiotic guidelines in hospital practice
Cortoos, P. (2011)
Koller, M. T. (2001) · Langenbecks Archiv für Chirurgie. Supplement · doi:10.1007/978-3-642-56458-1_283
(2008) · New South Wales Public Health Bulletin · doi:10.1071/nbv19n4
Dupont, C., Touzet, S., Cao, D., Prunaret-Julien, V., Audra, P., Putet, G., Dupuis, O., & Rudigoz, R. C. (2006) · Sages-Femmes · doi:10.1016/s1637-4088(06)76025-4
Conceptual Underpinnings of the Evidence-Based Practice Sustainability Index
Manthey, T. J., & Goscha, R. (2013) · Best practices in mental health · doi:10.70256/445205tyelds
Impact de recommandations locales pour la prise en charge des infections urinaires à l'hôpital
Arnaud, I. (2005) · OpenGrey (Institut de l'Information Scientifique et Technique)
Tirer le meilleur parti de la situation
Øvretveit, J., & Staines, A. S. (2011) · Springer eBooks · doi:10.1007/978-2-8178-0229-9_6
Bearman, S. K., Rohde, P., Pauling, S., Gau, J., Shaw, H. E., & Stice, E. M. (2024) · Figshare · doi:10.6084/m9.figshare.26743280
Ritchie, M. J., Parker, L. E., & Kirchner, J. E. (2020) · Figshare · doi:10.6084/m9.figshare.11986323
Bearman, S. K., Rohde, P., Pauling, S., Gau, J. M., Shaw, H. E., & Stice, E. M. (2024) · Figshare · doi:10.6084/m9.figshare.26743283
Metadata
- Authors
- Solberg, L. I., Brekke, M. L., Fazio, C. J., Fowles, J., Jacobsen, D. N., Kottke, T. E., Mosser, G., O’Connor, P. J., Ohnsorg, K. A., & Rolnick, S. J.
- Affiliations
- HealthPartners (US)
- Joint Commission (US)
- International Computer Science Institute (US)
- Mayo Clinic (US)
- Corresponding author
- Solberg, Leif I.
- Venue
- The Joint Commission Journal on Quality Improvement
- Publisher
- Elsevier BV
- Published
- 2000-04
- Volume
- 26
- Issue
- 4
- Pages
- 171-188
- ISSN
- 1070-3241 (ISSN-L)
- OpenAlex
- W2397003148
- Cited by
- 259
- References
- 28
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2022: 1 · 2021: 5 · 2020: 6 · 2019: 8 · 2018: 6 · 2017: 1 · 2016: 6 · 2015: 10 · 2014: 11 · 2013: 12 · 2012: 11
- FWCI
- 17.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Joint Commission Journal on Quality Improvement (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline implementation, implementation strategies, organizational infrastructure, external environment, clinician behavior change, expert consensus, Delphi method, nominal group technique
- MeSH terms
- Delphi Technique, Group Practice, Planning Techniques, Focus Groups, Practice Guidelines as Topic, Total Quality Management, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review