Lessons from Experienced Guideline Implementers: Attend to Many Factors and Use Multiple Strategies
Abstract
Background Studies of clinical guideline implementation have focused almost entirely on changing individual clinician behavior with single intervention strategies and without much attention to the situational context. The goal of this project was to learn from clinic leaders, seasoned in the guideline implementation process, what contextual variables they viewed as important and whether implementation success could be expected if only a single implementation strategy was used.Methods In 1998, 12 people with extensive experience in leading clinical guideline implementation were identified who were thought to have particularly keen insight into the process. They were interviewed to generate variables they considered important, as well as strategies they considered effective when used appropriately. A modified nominal group/Delphi process was then used for rating these variables and strategies, and the reactions of international experts were obtained to add perspective to this information.Results Eighty-seven variables and 25 strategies were identified, clustering in 6 categories (ranked in order of importance by the panel): organizational capabilities for change, infrastructure for implementation, implementation strategies, medical group characteristics, guideline characteristics, and external environment. All six categories were considered to be important, key, or essential by the experienced implementers, although variables within a medical group that directly affect its ability to undertake planned change were rated as much more important than either guideline characteristics or the external environment.Discussion Although the opinions of those experienced in the process of guideline implementation are primarily of value for generating hypotheses, panel members believe that implementation efforts focusing on the individual physician with a single strategy are unlikely to be successful. Rather, implementation efforts must use multiple strategies that take account of multiple characteristics of the guideline, practice organization, and external environment.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The empirical evidence for the effectiveness of multifaceted strategies has been mixed.
“The empirical evidence for the effectiveness of multifaceted strategies has been mixed, because early research touted the benefits of multifaceted strategies [98,99], while a systematic review of 235 implementation trials by Grimshaw et al. found no relationship between the number of component interventions and the effects of multifaceted interventions [100].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [99]
Cites
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,470 · see citing works
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
The Discovery of Grounded Theory: Strategies for Qualitative Research
Brodsky, C. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71872-7 · Cited by 6,727 · see citing works
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471 · see citing works
Hayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,771 · see citing works
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396 · see citing works
(1997) · Europe PMC (PubMed Central) · Cited by 1,226 · see citing works
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877 · see citing works
A primer on leading the improvement of systems: Fig 1
Berwick, D. M. (1996) · BMJ · doi:10.1136/bmj.312.7031.619 · Cited by 793 · see citing works
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S. A., Russell, I. T., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · BMJ Quality & Safety · doi:10.1136/qshc.4.1.55 · Cited by 467 · see citing works
Grilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392 · see citing works
Systematic Reviews: Critical Links in the Great Chain of Evidence
Mulrow, C. D., Cook, D. J., & Davidoff, F. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00008 · Cited by 262 · see citing works
Understanding change in primary care practice using complexity theory.
Miller, W. L., Crabtree, B. F., McDaniel, R., & Stange, K. C. (1998) · PubMed · Cited by 233 · see citing works
Garside, P. (1998) · PubMed · Cited by 143 · see citing works
Primary care practice organization and preventive services delivery: a qualitative analysis.
Crabtree, B. F., Miller, W. L., Aita, V., Flocke, S. A., & Stange, K. C. (1998) · PubMed · Cited by 123 · see citing works
Implementing Clinical Practice Guidelines
Margolis, C. Z., & Cretin, S. (1998) · Cited by 110 · see citing works
Time for organisational development in healthcare organisations
Koeck, C. M. (1998) · BMJ · doi:10.1136/bmj.317.7168.1267 · Cited by 78 · see citing works
O’Connor, P. J., Solberg, L. I., Christianson, J. B., Amundson, G. H., & Mosser, G. (1996) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30274-7 · Cited by 59 · see citing works
Self-citationUsing practice genograms to understand and describe practice configurations.
McIlvain, H. E., Crabtree, B. F., Medder, J., Stange, K. C., & Miller, W. L. (1998) · PubMed · Cited by 50 · see citing works
Setting Priorities for Clinical Practice Guidelines
Institute of Medicine (1995) · National Academies Press eBooks · doi:10.17226/4959 · Cited by 49 · see citing works
Implementing clinical practice guidelines
Craft, P., Tait, N., & Buckingham, J. M. (2000) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2000.tb125582.x · Cited by 47 · see citing works
Mosser, G. (1996) · Quality Management in Health Care · doi:10.1097/00019514-199604040-00003 · Cited by 38 · see citing works
Self-citationOrganizational Tactics for the Successful Assimilation of Medical Practice Guidelines
Sonnad, S. S. (1998) · Health Care Management Review · doi:10.1097/00004010-199802330-00004 · Cited by 38 · see citing works
Primary Care, Process Improvement, and Turmoil
Magnan, S. J., Solberg, L. I., Giles, K., Kottke, T. E., & Wheeler, J. W. (1997) · Journal of Ambulatory Care Management · doi:10.1097/00004479-199710000-00006 · Cited by 31 · see citing works
Self-citationPalmer, R. H., & Hargraves, J. L. (1996) · Medical Care · doi:10.1097/00005650-199609002-00010 · Cited by 16 · see citing works
Assessing the Impact of Clinical Guidelines
Rolnick, S. J., & O’Connor, P. J. (1997) · Journal of Ambulatory Care Management · doi:10.1097/00004479-199710000-00008 · Cited by 10 · see citing works
Self-citationThe Contribution of Realism to Evaluation Research
Drewett, A. (1998) · Journal of Health Services Research & Policy · doi:10.1177/135581969800300411 · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 28 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531 · see citing works
Clinical Practice Guidelines We Can Trust
Board on Health Care Services (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,102 · see citing works
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703 · see citing works
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069 · see citing works
Feldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987 · see citing works
Improving the Quality of Medical Care
Grol, R. P. T. M. (2001) · JAMA · doi:10.1001/jama.286.20.2578 · Cited by 594 · see citing works
Casalino, L. P., Gillies, R. R., Shortell, S. M., Schmittdiel, J. A., Bodenheimer, T. S., Robinson, J. C., Rundall, T. G., Oswald, N., Schauffler, H. H., & Wang, M. C. (2003) · JAMA · doi:10.1001/jama.289.4.434 · Cited by 473 · see citing works
Roshanov, P. S., Fernandes, N., Wilczynski, J. M., Hemens, B. J., You, J. J., Handler, S. M., Nieuwlaat, R., Souza, N. M., Beyene, J., Spall, H. G. C. V., et al. (2013) · BMJ · doi:10.1136/bmj.f657 · Cited by 458 · see citing works
Does the Chronic Care Model Serve Also as a Template for Improving Prevention?
Glasgow, R. E., Orleans, C. T., Wagner, E. H., Curry, S. J., & Solberg, L. I. (2001) · Milbank Quarterly · doi:10.1111/1468-0009.00222 · Cited by 447 · see citing works
Self-citationShiffman, R. N., Dixon, J. K., Brandt, C., Essaihi, A., Hsiao, A., Michel, G., & O’Connell, R. T. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-23 · Cited by 387 · see citing works
Melnyk, B. M., Fineout‐Overholt, E., Feinstein, N. F., Li, H., Small, L., Wilcox, L., & Kraus, R. A. (2004) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1524-475x.2004.04024.x · Cited by 372 · see citing works
Øvretveit, J. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.045955 · Cited by 337 · see citing works
Uncovering middle managers' role in healthcare innovation implementation
Birken, S. A., Lee, S.-Y. D., & Weiner, B. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-28 · Cited by 315 · see citing works
Management of Patients With Venous Leg Ulcers: Challenges and Current Best Practice
Franks, P. J., Barker, J., Collier, M. A., Gethin, G., Haesler, E., Jawień, A., Laeuchli, S., Mosti, G. B., Probst, S., & Weller, C. D. (2016) · Journal of Wound Care · doi:10.12968/jowc.2016.25.sup6.s1 · Cited by 313 · see citing works
Quality improvement research: understanding the science of change in health care
Grol, R. P. T. M. (2002) · BMJ Quality & Safety · doi:10.1136/qhc.11.2.110 · Cited by 296 · see citing works
Appraisal Tools for Clinical Practice Guidelines: A Systematic Review
Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082915 · Cited by 233 · see citing works
Kastner, M., Bhattacharyya, O. K., Hayden, L., Makarski, J., Estey, E. A., Durocher, L. D., Chatterjee, A., Perrier, L., Graham, I. D., Straus, S. E., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.013 · Cited by 214 · see citing works
Cerebral Edema in Childhood Diabetic Ketoacidosis
MUIR, A. B., Quisling, R. G., Yang, M. C. K., & Rosenbloom, A. L. (2004) · Diabetes Care · doi:10.2337/diacare.27.7.1541 · Cited by 206 · see citing works
Assessing the Implementation of the Chronic Care Model in Quality Improvement Collaboratives
Pearson, M. L., Wu, S., Schaefer, J. K., Bonomi, A. E., Shortell, S. M., Mendel, P. J., Marsteller, J. A., Louis, T. A., Rosen, M., & Keeler, E. B. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00397.x · Cited by 205 · see citing works
Zapka, J. G., Taplin, S. H., Solberg, L. I., & Manos, M. M. (2003) · PubMed · Cited by 201 · see citing works
Self-citationPrimary Care Practice Transformation is Hard Work
Crabtree, B. F., Nutting, P. A., Miller, W. L., McDaniel, R. R., Stange, K. C., Jaén, C. R., & Stewart, E. E. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181cad65c · Cited by 194 · see citing works
Writing implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169 · see citing works
Roski, J., Jeddeloh, R., An, L. C., Lando, H. A., Hannan, P. J., Hall, C., & Zhu, S. (2003) · Preventive Medicine · doi:10.1016/s0091-7435(02)00052-x · Cited by 183 · see citing works
Ansari, M. N., Shlipak, M. G., Heidenreich, P. A., Ostaeyen, D. V., Pohl, E. C., Browner, W. S., & Massie, B. M. (2003) · Circulation · doi:10.1161/01.cir.0000070952.08969.5b · Cited by 182 · see citing works
Toward a theory of evidence based decision making
Baba, V. V., & HakemZadeh, F. (2012) · Management Decision · doi:10.1108/00251741211227546 · Cited by 167 · see citing works
Øvretveit, J. (2009) · Cited by 162 · see citing works
Challenges of Change: A Qualitative Study of Chronic Care Model Implementation
Hroscikoski, M. C. (2006) · The Annals of Family Medicine · doi:10.1370/afm.570 · Cited by 165 · see citing works
Randomized Clinical Trial of a Quality Improvement Intervention in Nursing Homes
Rantz, M. J., Popejoy, L., Petroski, G. F., Madsen, R. W., Mehr, D. R., Zwygart-Stauffacher, M., Hicks, L. L., Grando, V., Wipke-Tevis, D. D., Bostick, J., et al. (2001) · The Gerontologist · doi:10.1093/geront/41.4.525 · Cited by 162 · see citing works
What Is Implementation Research?
Bhattacharyya, O. K., Reeves, S., & Zwarenstein, M. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335528 · Cited by 162 · see citing works
The Evidence for Evidence-Based Practice Implementation
Titler, M. G. (2008) · Cited by 148 · see citing works
Hung, D. Y., Rundall, T. G., Tallia, A. F., Cohen, D. J., Halpin, H. A., & Crabtree, B. F. (2007) · Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00477.x · Cited by 146 · see citing works
A systematic review of integrated use of disease-management interventions in asthma and COPD
Lemmens, K. M. M., Nieboer, A. P., & Huijsman, R. (2009) · Respiratory Medicine · doi:10.1016/j.rmed.2008.11.017 · Cited by 141 · see citing works
Clinical Inertia and Outpatient Medical Errors
O’Connor, P. J., Sperl‐Hillen, J. M., Johnson, P. E., Rush, W. A., & Biltz, G. R. (2008) · Journal of Medical Regulation · doi:10.30770/2572-1852-94.2.19 · Cited by 135 · see citing works
Self-citationStrategies for Improving Fidelity in the National Evidence-Based Practices Project
Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., & Whitley, R. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335531 · Cited by 134 · see citing works
The Role of Nursing Best Practice Champions in Diffusing Practice Guidelines: A Mixed Methods Study
Ploeg, J., Skelly, J., Rowan, M. S., Edwards, N. C., Davies, B., Grinspun, D. R., Bajnok, I., & Downey, A. M. (2010) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2010.00202.x · Cited by 132 · see citing works
Guideline Implementation: What the Literature Doesn’t Tell Us
Solberg, L. I. (2000) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(00)26044-6 · Cited by 129 · see citing works
Self-citationImproving Medical Practice: A Conceptual Framework
Solberg, L. I. (2007) · The Annals of Family Medicine · doi:10.1370/afm.666 · Cited by 124 · see citing works
Self-citationBauchner, H., SIMPSON, L., & Chessare, J. B. (2001) · Archives of Disease in Childhood · doi:10.1136/adc.84.6.459 · Cited by 119 · see citing works
Delivery of Clinical Preventive Services in Family Medicine Offices
Crabtree, B. F. (2005) · The Annals of Family Medicine · doi:10.1370/afm.345 · Cited by 114 · see citing works
Interactive Preventive Health Record to Enhance Delivery of Recommended Care: A Randomized Trial
Krist, A. H., Woolf, S. H., Rothemich, S. F., Johnson, R. E., Peele, J. E., Cunningham, T. D., Longo, D. R., Bello, G., & Matzke, G. R. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1383 · Cited by 112 · see citing works
Annals Journal Club: It's Time to Get RADICAL
Stange, K. C. (2006) · The Annals of Family Medicine · doi:10.1370/afm.588 · Cited by 112 · see citing works
Barriers to paediatric nurses' research utilization
McCleary, L., & Brown, T. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02628.x · Cited by 111 · see citing works
Grol, R. P. T. M. (2002) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340220409 · Cited by 109 · see citing works
The DIAMOND initiative: implementing collaborative care for depression in 75 primary care clinics
Solberg, L. I., Crain, A. L., Jaeckels, N., Ohnsorg, K. A., Margolis, K. L., Beck, A. L., Whitebird, R. R., Rossom, R. C., Crabtree, B. F., & de Ven, A. H. V. (2013) · Implementation Science · doi:10.1186/1748-5908-8-135 · Cited by 107 · see citing works
Self-citationOrganizational factors that support the implementation of a nursing Best Practice Guideline
Marchionni, C., & Ritchie, J. A. (2008) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2007.00775.x · Cited by 107 · see citing works
Clinical guidelines: what can we do to increase their use?
Grol, R. P. T. M., & Buchan, H. (2006) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00580.x · Cited by 104 · see citing works
Improving the Effectiveness of Health Care Innovation Implementation
Birken, S. A., Lee, S.-Y. D., Weiner, B. J., Chin, M. H., & Schaefer, C. T. (2012) · Medical Care Research and Review · doi:10.1177/1077558712457427 · Cited by 108 · see citing works
Measuring persistence of implementation: QUERI Series
Initiative, T. H. Q. E. R., Bowman, C. C., Sobo, E. J., Asch, S. M., & Gifford, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-21 · Cited by 100 · see citing works
Implementing Evidence-Based Practice in Home Care
Benefield, L. E. (2003) · Home Healthcare Now · doi:10.1097/00004045-200312000-00005 · Cited by 101 · see citing works
Côté, A.-M., Durand, M., Tousignant, M., & Poitras, S. (2009) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-009-9167-2 · Cited by 98 · see citing works
From novice to expert: a qualitative study of implementation facilitation skills
Ritchie, M. J., Parker, L. E., & Kirchner, J. E. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00006-8 · Cited by 94 · see citing works
Wirtschafter, D. D., Pettit, J., Kurtin, P. S., Dalsey, M., Chance, K., Morrow, H. W., Seid, M., Byczkowski, T. L., Huber, T., Milstein, J. M., et al. (2009) · Journal of Perinatology · doi:10.1038/jp.2009.172 · Cited by 94 · see citing works
Solberg, L. I., Asche, S. E., Margolis, K. L., & Whitebird, R. R. (2008) · American Journal of Medical Quality · doi:10.1177/1062860608314942 · Cited by 90 · see citing works
Self-citationHarrington, J. T., Barash, H. L., Day, S., & Lease, J. (2005) · Arthritis Care & Research · doi:10.1002/art.21072 · Cited by 87 · see citing works
Exploring obstacles to proper timing of prophylactic antibiotics for surgical site infections
Tan, J. (2006) · BMJ Quality & Safety · doi:10.1136/qshc.2004.012534 · Cited by 86 · see citing works
The Contingencies of Organizational Learning in Long-Term Care
Berta, W. B., Teare, G. F., Gilbart, E., Ginsburg, L. S., Lemieux‐Charles, L., Davis, D., & Rappolt, S. G. (2005) · Health Care Management Review · doi:10.1097/00004010-200510000-00002 · Cited by 86 · see citing works
Stetler, C. B., Ritchie, J. A., Rycroft‐Malone, J., Schultz, A. A., & Charns, M. P. (2007) · Implementation Science · doi:10.1186/1748-5908-2-3 · Cited by 84 · see citing works
O’Connor, P. J., DESAI, J. R., Solberg, L. I., Reger, L. A., Crain, A. L., Asche, S. E., Pearson, T. L., Clark, C., Rush, W. A., Cherney, L. M., et al. (2005) · Diabetes Care · doi:10.2337/diacare.28.8.1890 · Cited by 84 · see citing works
Self-citationMedicine and evidence: knowledge and action in clinical practice
Miles, A., Loughlin, M., & Polychronis, A. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00923.x · Cited by 82 · see citing works
Appropriate Use Criteria For Stress Single-Photon Emission Computed Tomography Sestamibi Studies
Gibbons, R. J., Askew, J. W., Hodge, D. O., Kaping, B., Carryer, D. J., & Miller, T. D. (2011) · Circulation · doi:10.1161/circulationaha.110.975995 · Cited by 79 · see citing works
Do Local Opinion Leaders Augment Hospital Quality Improvement Efforts?
Berner, E. S., Baker, C. S., Funkhouser, E. M., Heudebert, G. R., Allison, J. J., Fargason, C. A., Li, Q., Person, S. D., & Kiefe, C. I. (2003) · Medical Care · doi:10.1097/01.mlr.0000052977.24246.38 · Cited by 78 · see citing works
Implementing person-centered care in nursing homes
Rosemond, C. A., Hanson, L. C., Ennett, S. T., Schenck, A. P., & Weiner, B. J. (2012) · Health Care Management Review · doi:10.1097/hmr.0b013e318235ed17 · Cited by 78 · see citing works
Dickinson, W. P., Dickinson, L. M., Nutting, P. A., Emsermann, C. B., Tutt, B., Crabtree, B. F., Fisher, L., Harbrecht, M. G., Gottsman, A., & West, D. R. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1591 · Cited by 77 · see citing works
Kumwilaisak, K., Noto, A., Schmidt, U. H., Beck, C. I., Crimi, C., Lewandrowski, K. B., & Bigatello, L. M. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e31818b3a9d · Cited by 75 · see citing works
Implementing Best Practice Pain Management in a Pediatric Hospital
Ellis, J. A., McCleary, L., Blouin, R., Dubé, K., Rowley, B., MacNeil, M., & Cooke, C. (2007) · Journal for Specialists in Pediatric Nursing · doi:10.1111/j.1744-6155.2007.00121.x · Cited by 74 · see citing works
Powell, B. J., Proctor, E. K., Glisson, C. A., Kohl, P. L., Raghavan, R., Brownson, R. C., Stoner, B. P., Carpenter, C. R., & Palinkas, L. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-92 · Cited by 71 · see citing works
An Electronic Linkage System for Health Behavior Counseling
Krist, A. H., Woolf, S. H., Frazier, C. R., Johnson, R. E., Rothemich, S. F., Wilson, D., Devers, K. J., & Kerns, J. W. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.08.010 · Cited by 71 · see citing works
Putting It Together: Finding Success in Behavior Change Through Integration of Services
Woolf, S. H. (2005) · The Annals of Family Medicine · doi:10.1370/afm.367 · Cited by 70 · see citing works
Understanding context: A concept analysis
Squires, J. E., Graham, I. D., Bashir, K., Penno, L. N., Lavis, J. N., Francis, J., Curran, J., Grimshaw, J., Brehaut, J., Ivers, N. M., et al. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.14165 · Cited by 63 · see citing works
Variation in test ordering behaviour of GPs: professional or context-related factors?
Verstappen, W. H. J. M. (2004) · Family Practice · doi:10.1093/fampra/cmh408 · Cited by 63 · see citing works
Boulet, L., Becker, A. B., BOWIE, D. M., Hernandez, P., McIvor, A., Rouleau, M., Bourbeau, J., Graham, I. D., Logan, J., Légaré, F., et al. (2006) · Canadian Respiratory Journal · doi:10.1155/2006/810978 · Cited by 63 · see citing works
Risk Stratification in the Setting of Non-ST Elevation Acute Coronary Syndromes 1999-2007
Ranasinghe, I., Aliprandi‐Costa, B., Chow, V., Elliott, J. M., Waites, J. H., Counsell, J., López-Sendón, J. L., Avezum, Á., Goodman, S. G., Granger, C. B., et al. (2011) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2011.04.005 · Cited by 63 · see citing works
Balasubramanian, B. A., Chase, S. M., Nutting, P. A., Cohen, D. J., Strickland, P. A. O., Crosson, J. C., Miller, W. L., Crabtree, B. F., & the ULTRA Study Team (2010) · The Annals of Family Medicine · doi:10.1370/afm.1159 · Cited by 60 · see citing works
Fleiszer, A. R., Semenic, S. E., Ritchie, J. A., Richer, M., & Denis, J. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.09.004 · Cited by 57 · see citing works
Increasing smoking cessation care provision in hospitals: A meta-analysis of intervention effect
Freund, M., Campbell, E. M., Paul, C. L., Sakrouge, R., McElduff, P., Walsh, R. A., Wiggers, J., Knight, J., & Girgis, A. (2009) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntp056 · Cited by 50 · see citing works
A Medical Assistant-Based Program to Promote Healthy Behaviors in Primary Care
Ferrer, R. L., Mody-Bailey, P., Jaén, C. R., Gott, S., & Araujo, S. (2009) · The Annals of Family Medicine · doi:10.1370/afm.1059 · Cited by 54 · see citing works
Screening for Intimate Partner and Sexual Violence in College Women: Missed Opportunities
Sutherland, M. A., Fantasia, H. C., & Hutchinson, M. K. (2015) · Women s Health Issues · doi:10.1016/j.whi.2015.07.008 · Cited by 52 · see citing works
?Are you better?? A qualitative study of the meaning of recovery
Beaton, D., Tarasuk, V. S., Katz, J. N., Wright, J. G., & Bombardier, C. (2001) · Arthritis & Rheumatism · doi:10.1002/1529-0131(200106)45:3 · Cited by 163 · see citing works
Sources and Models for Moving Research Evidence Into Clinical Practice
Davies, B. (2002) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1111/j.1552-6909.2002.tb00081.x · Cited by 51 · see citing works
Sussman, A. L. (2006) · The Annals of Family Medicine · doi:10.1370/afm.566 · Cited by 51 · see citing works
Feifer, C., Ornstein, S. M., Jenkins, R., Wessell, A. M., Corley, S. T., Nemeth, L. S., Roylance, L. F., Nietert, P. J., & Liszka, H. A. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284443 · Cited by 50 · see citing works
Accessing Care Through the Veterans Choice Program: The Veteran Experience
Sayre, G. G., Neely, E. L., Simons, C. E., Sulc, C. A., Au, D. H., & Ho, P. M. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4574-8 · Cited by 49 · see citing works
Enhancing the Use of Clinical Guidelines: A Social Norms Perspective
(2006) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2006.03.011 · Cited by 49 · see citing works
Use of Quality Improvement Strategies Among Small to Medium-Size US Primary Care Practices
Balasubramanian, B. A., Marino, M., Cohen, D. J., Ward, R. L., Preston, A., Springer, R. J., Lindner, S., Edwards, S. T., McConnell, K. J., Crabtree, B. F., et al. (2018) · The Annals of Family Medicine · doi:10.1370/afm.2172 · Cited by 48 · see citing works
Self-citationOrganizational Predictors of Adherence to Ambulatory Care Screening Guidelines
Vaughn, T. E., McCoy, K. D., BootsMiller, B. J., Woolson, R. F., Sorofman, B. A., Tripp‐Reimer, T., Perlin, J. A., & Doebbeling, B. N. (2002) · Medical Care · doi:10.1097/00005650-200212000-00005 · Cited by 47 · see citing works
From Science to Service: A Framework for the Transfer of Patient Safety Research into Practice
Nieva, V. F., Murphy, R., Ridley, N., Donaldson, N. E., Combes, J., Mitchell, P., Kovner, C. T., Hoy, E., & Carpenter, D. (2005) · Cited by 47 · see citing works
A Framework for Quality Improvement Translation: Understanding the Conditionality of Interventions
Øvretveit, J. (2004) · The Joint Commission Journal on Quality and Safety · doi:10.1016/s1549-3741(04)30105-x · Cited by 47 · see citing works
Barriers to Optimal Assessment of Lymph Nodes in Colorectal Cancer Specimens
Wright, F. C., Law, C., Last, L. D., Ritacco, R., Kumar, D., Hsieh, E., Hsieh, E., & Khalifa, M. (2004) · American Journal of Clinical Pathology · doi:10.1309/17vk-m33b-fxf9-t8wd · Cited by 44 · see citing works
Physician Pay-For-Performance.
Christianson, J. B., Knutson, D. J., & Mazze, R. S. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0268-8 · Cited by 43 · see citing works
Dissemination of the AHCPR clinical practice guideline in community health centres
DePue, J. D., Goldstein, M. G., Schilling, A., Reiss, P. T., Papandonatos, G. D., Sciamanna, C., & Kazura, A. N. (2002) · Tobacco Control · doi:10.1136/tc.11.4.329 · Cited by 44 · see citing works
A randomized trial of strategies to increase chlamydia screening in young women
Scholes, D., Grothaus, L. C., McClure, J. B., Reid, R. J., Fishman, P. A., Sisk, C. A., Lindenbaum, J. E., Green, B. B., Grafton, J. R., & Thompson, R. S. (2006) · Preventive Medicine · doi:10.1016/j.ypmed.2006.04.019 · Cited by 43 · see citing works
Dosh, S. A. (2005) · The Annals of Family Medicine · doi:10.1370/afm.357 · Cited by 43 · see citing works
Dennehy, E. B., PhD, Bauer, M. S., MD, Perlis, R. H., MD, Kogan, J. N., PhD, Sachs, A. G., & MD (2025) · Psychopharmacology Bulletin · doi:10.64719/pb.4110 · Cited by 43 · see citing works
Evaluation of a hospital‐based tobacco treatment service: Outcomes and lessons learned
Faseru, B., Turner, M., Casey, G., Ruder, C., Befort, C. A., Ellerbeck, E. F., & Richter, K. P. (2010) · Journal of Hospital Medicine · doi:10.1002/jhm.835 · Cited by 42 · see citing works
Finding safety in medical education
Stevens, D. P. (2002) · BMJ Quality & Safety · doi:10.1136/qhc.11.2.109 · Cited by 42 · see citing works
Fallon, T., Buikstra, E., Cameron, M., Hegney, D. G., Mackenzie, D., March, J., Moloney, C., & Pitt, J. (2006) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2006.00040.x · Cited by 40 · see citing works
Improving Asthma Care in Rural Primary Care Practices: A Performance Improvement Project
Cicutto, L. C., Dingae, M. B., & Langmack, E. L. (2014) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21254 · Cited by 39 · see citing works
Levine, D. A., Saag, K. G., Casebeer, L. L., Colon-Emeric, C. S., Lyles, K. W., & Shewchuk, R. M. (2006) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2006.05.004 · Cited by 39 · see citing works
Jaglal, S. B., HAWKER, G. A., Bansod, V., Salbach, N. M., Zwarenstein, M., Carroll, J. C., Brooks, D., Cameron, C., Bogoch, E. R., Jaakkimainen, L., et al. (2008) · Osteoporosis International · doi:10.1007/s00198-008-0654-7 · Cited by 38 · see citing works
A Comparison of Guidelines for the Treatment of Schizophrenia
Milner, K. K., & Valenstein, M. M. (2002) · Psychiatric Services · doi:10.1176/appi.ps.53.7.888 · Cited by 37 · see citing works
- Authors
- Solberg, L. I., Brekke, M. L., Fazio, C. J., Fowles, J., Jacobsen, D. N., Kottke, T. E., Mosser, G., O’Connor, P. J., Ohnsorg, K. A., & Rolnick, S. J.
- Affiliations
- HealthPartners (US)
- Joint Commission (US)
- International Computer Science Institute (US)
- Mayo Clinic (US)
- Corresponding author
- Solberg, Leif I.
- Venue
- The Joint Commission Journal on Quality Improvement
- Publisher
- Elsevier BV
- Published
- 2000-04
- Volume
- 26
- Issue
- 4
- Pages
- 171-188
- ISSN
- 1070-3241 (ISSN-L)
- OpenAlex
- W2397003148
- Cited by
- 259
- References
- 28
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2022: 1 · 2021: 5 · 2020: 6 · 2019: 8 · 2018: 6 · 2017: 1 · 2016: 6 · 2015: 10 · 2014: 11 · 2013: 12 · 2012: 11
- FWCI
- 17.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Joint Commission Journal on Quality Improvement (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- guideline implementation, implementation strategies, organizational infrastructure, external environment, clinician behavior change, expert consensus, Delphi method, nominal group technique
- MeSH terms
- Delphi Technique, Group Practice, Planning Techniques, Focus Groups, Practice Guidelines as Topic, Total Quality Management, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review