The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Changing Provider Behavior: An Overview of Systematic Reviews of Interventions
Abstract
Background. Increasing recognition of the failure to translate research findings into practice has led to greater awareness of the importance of using active dissemination and implementation strategies. Although there is a growing body of research evidence about the effectiveness of different strategies, this is not easily accessible to policy makers and professionals. Objectives. To identify, appraise, and synthesize systematic reviews of professional educational or quality assurance interventions to improve quality of care. Research design. An overview was made of systematic reviews of professional behavior change interventions published between 1966 and 1998. Results. Forty-one reviews were identified covering a wide range of interventions and behaviors. In general, passive approaches are generally ineffective and unlikely to result in behavior change. Most other interventions are effective under some circumstances; none are effective under all circumstances. Promising approaches include educational outreach (for prescribing) and reminders. Multifaceted interventions targeting different barriers to change are more likely to be effective than single interventions. Conclusions. Although the current evidence base is incomplete, it provides valuable insights into the likely effectiveness of different interventions. Future quality improvement or educational activities should be informed by the findings of systematic reviews of professional behavior change interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Science of Reviewing Researcha
OXMAN, A. D., & GUYATT, G. H. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26342.x · Cited by 472
Self-citationGrilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392
Self-citation
Research works printed but not linked: 39
- Grol, 1999, Jt Comm J Qual Improv, 25, 503
- Haynes, 1983, Arch Intern Med, 143, 1971, 10.1001/archinte.143.10.1971 · DOI
- Guyatt, 1993, JAMA, 270, 2096, 10.1001/jama.270.17.2096 · DOI · Paper page
- Bero, 1998, Br Med J, 317, 265, 10.1136/bmj.317.7156.465 · DOI · Paper page
- Grimshaw, 1993, A systematic review of rigorous evaluations Lancet, 342, 1317
- Oxman, 1994, Br Med J, 309, 648, 10.1136/bmj.309.6955.648 · DOI · Paper page
- Whiting-O’Keefe, 1984, Med Care, 22, 1101, 10.1097/00005650-198412000-00005 · DOI
- Bertram, 1977, Health Education Monographs, 5, 330, 10.1177/109019817700500404 · DOI
- Lloyd, 1979, Evaluation the Health Professions, 2, 251, 10.1177/016327877900200301 · DOI
- Beaudry, 1989, J Continuing Education in the Health Professions, 9, 285, 10.1002/chp.4750090414 · DOI
- Waddell, 1991, J Continuing Education in Nursing, 22, 113, 10.3928/0022-0124-19910501-09 · DOI
- Davis, 1995, JAMA, 274, 700, 10.1001/jama.274.9.700 · DOI · Paper page
- Lomas, 1991, The production dissemination impact of consensus recommendations Annu Rev Public Health, 12, 41
- Oxman, 1995, Can Med Assoc J, 153, 1423
- Davis, 1997, A systematic review of theoretical concepts practical experience research evidence in the adoption of clinical practice guidelines Can Med Assoc J, 157, 408
- Worrall, 1997, Can Med Assoc J, 156, 1705
- Wensing, 1998, Br J Gen Pract, 48, 991
- Yano, 1995, Lessons from the literature Arch Intern Med, 155, 1146, 10.1001/archinte.1995.00430110051006 · DOI
- Lomas, 1988, Am J Prev Med, 2, 77
- Gyorkos, 1994, Can J Public Health, 85, S14
- Mandelblatt, 1995, J Fam Pract, 40, 162
- Snell, 1996, Prev Med, 25, 702, 10.1006/pmed.1996.0109 · DOI
- Soumerai, 1989, Milbank Q, 67, 268, 10.2307/3350142 · DOI · Paper page
- Gurwitz, 1990, J Am Geriatr Soc, 38, 542, 10.1111/j.1532-5415.1990.tb02406.x · DOI
- Anderson, 1996, Can Med Assoc J, 154, 1013
- Solomon, 1998, JAMA, 280, 2020, 10.1001/jama.280.23.2020 · DOI · Paper page
- Hanson, 1997, Ann Intern Med, 126, 381, 10.7326/0003-4819-126-5-199703010-00007 · DOI
- Mugford, 1991, Br Med J, 303, 398, 10.1136/bmj.303.6799.398 · DOI · Paper page
- Buntinx, 1993, A Review Fam Pract, 10, 219, 10.1093/fampra/10.2.219 · DOI
- Balas, 1996, J Gen Intern Med, 11, 584, 10.1007/BF02599025 · DOI
- Austin, 1994, Proc Annu Symp Comput Appl Med Care, 121-, 4
- Shea, 1996, J Am Med Inform Assoc, 3, 399, 10.1136/jamia.1996.97084513 · DOI · Paper page
- Hunt, 1998, A systematic review JAMA, 280, 1339
- Sullivan, 1995, A systematic review of published reports Br Med J, 311, 848
- Balas, 1996, Arch Fam Med, 5, 271, 10.1001/archfami.5.5.271 · DOI
- Beilby, 1997, MJA, 167, 89
- Shortell, 1998, Milbank Q, 76, 1, 10.1111/1468-0009.00107 · DOI · Paper page
- Soumerai, 1990, JAMA, 263, 549, 10.1001/jama.263.4.549 · DOI
- Grimshaw, 2000, Fam Pract, 17, S11, 10.1093/fampra/17.suppl_1.S11 · DOI · Paper page
Cited by
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationFrom best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Self-citationAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Self-citationThomas, B. H., Ciliska, D., Dobbins, M., & Micucci, S. (2004) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1524-475x.2004.04006.x · Cited by 2,118
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Self-citationA world of standards but not a standard world: Toward a sociology of standards and standardization
Timmermans, S., & Epstein, S. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102629 · Cited by 1,226
How Can Research Organizations More Effectively Transfer Research Knowledge to Decision Makers?
LAVIS, J. N., ROBERTSON, D., WOODSIDE, J. M., McLEOD, C. B., & ABELSON, J. (2003) · The Milbank Quarterly · doi:10.1111/1468-0009.t01-1-00052 · Cited by 1,176
Godin, G., Bélanger-Gravel, A., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-36 · Cited by 1,096
Self-citationEccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917
Self-citationAudit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Self-citationReilly, B. M., & Evans, A. T. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-3-200602070-00009 · Cited by 794
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565
Donovan, J., Little, P., Mills, N., Smith, M., Brindle, L., Jacoby, A., Peters, T., Frankel, S., Neal, D., & Hamdy, F. (2002) · BMJ · doi:10.1136/bmj.325.7367.766 · Cited by 533
Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006) · Medical Teacher · doi:10.1080/01421590600622665 · Cited by 500
The JBI model of evidence-based healthcare
Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2005.00026.x · Cited by 451
Loisel, P., Buchbinder, R., Hazard, R., Keller, R., Scheel, I., van Tulder, M., & Webster, B. (2005) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-005-8031-2 · Cited by 403
Quality of Diabetes Care in U.S. Academic Medical Centers
Grant, R. W., Buse, J. B., Meigs, J. B., & for the University HealthSystem Consortium (UHC) Diabetes Benchmarking Project Team (2005) · Diabetes Care · doi:10.2337/diacare.28.2.337 · Cited by 311
Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306
Use of evidence in WHO recommendations
Oxman, A. D., Lavis, J. N., & Fretheim, A. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60675-8 · Cited by 287
Self-citationTranslating what we have learned into practice
Glasgow, R. E., Goldstein, M. G., Ockene, J. K., & Pronk, N. P. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.04.019 · Cited by 239
A systematic review of the use of theory in randomized controlled trials of audit and feedback
Colquhoun, H. L., Brehaut, J. C., Sales, A., Ivers, N., Grimshaw, J., Michie, S., Carroll, K., Chalifoux, M., & Eva, K. W. (2013) · Implementation Science · doi:10.1186/1748-5908-8-66 · Cited by 231
Self-citationScott, S. D., Plotnikoff, R. C., Karunamuni, N., Bize, R., & Rodgers, W. (2008) · Implementation Science · doi:10.1186/1748-5908-3-41 · Cited by 217
Chauhan, B. F., Jeyaraman, M., Mann, A. S., Lys, J., Skidmore, B., Sibley, K. M., Abou-Setta, A., & Zarychanksi, R. (2017) · Implementation Science · doi:10.1186/s13012-016-0538-8 · Cited by 210
Lyon, A. R., Stirman, S. W., Kerns, S. E. U., & Bruns, E. J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0331-y · Cited by 210
Interventions aimed at increasing research use in nursing: a systematic review
Thompson, D. S., Estabrooks, C. A., Scott-Findlay, S., Moore, K., & Wallin, L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-15 · Cited by 205
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-26 · Cited by 205
Pearson, S.-A., Moxey, A., Robertson, J., Hains, I., Williamson, M., Reeve, J., & Newby, D. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-154 · Cited by 193
van der Veer, S. N., de Keizer, N. F., Ravelli, A. C. J., Tenkink, S., & Jager, K. J. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.01.011 · Cited by 184
Foy, R., Ovretveit, J., Shekelle, P. G., Pronovost, P. J., Taylor, S. L., Dy, S., Hempel, S., McDonald, K. M., Rubenstein, L. V., & Wachter, R. M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.047993 · Cited by 148
Bekkering, G. E., van Tulder, M. W., Hendriks, E. J., Koopmanschap, M. A., Knol, D. L., Bouter, L. M., & Oostendorp, R. A. (2005) · Physical Therapy · doi:10.1093/ptj/85.6.544 · Cited by 141
A process for developing an implementation intervention: QUERI Series
Curran, G. M., Mukherjee, S., Allee, E., & Owen, R. R. (2008) · Implementation Science · doi:10.1186/1748-5908-3-17 · Cited by 110
Rational prescribing in primary care (RaPP): a cluster randomized trial of a tailored intervention
Fretheim, A., Oxman, A. D., Håvelsrud, K., Treweek, S., Kristoffersen, D. T., & Bjørndal, A. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030134 · Cited by 99
Self-citationNzinga, J., Mbindyo, P., Mbaabu, L., Warira, A., & English, M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-44 · Cited by 81
“Furthermore, while in developed countries investigators have employed psychological theories, such as the theory of planned behavior and/or social cognitive theory, to understand uptake of guidelines and show that attitudinal and control beliefs are important predictors of health workers' intentions and actions [22-24…”
BackgroundResultEllis, P., Robinson, P., Ciliska, D., Armour, T., Brouwers, M., O'Brien, M. A., Sussman, J., & Raina, P. (2005) · Health Psychology · doi:10.1037/0278-6133.24.5.488 · Cited by 81
Self-citationthe eCRT Research Team, McDermott, L., Yardley, L., Little, P., Ashworth, M., & Gulliford, M. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-90 · Cited by 62
Flottorp, S., & Oxman, A. D. (2003) · BMC Health Services Research · doi:10.1186/1472-6963-3-3 · Cited by 62
Self-citationLindner, S. A., Ben Davoren, J., Vollmer, A., Williams, B., & Seth Landefeld, C. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01214.x · Cited by 61
eHealth Research and Healthcare Delivery
Curry, S. J. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.026 · Cited by 61
Clyne, B., Bradley, M. C., Hughes, C. M., Clear, D., McDonnell, R., Williams, D., Fahey, T., & Smith, S. M. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-307 · Cited by 58
Finding order in heterogeneity: types of quality-improvement intervention publications
Rubenstein, L. V., Hempel, S., Farmer, M. M., Asch, S. M., Yano, E. M., Dougherty, D., & Shekelle, P. W. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.028423 · Cited by 52
Tickle, M., O’Neill, C., Donaldson, M., Birch, S., Noble, S., Killough, S., Murphy, L., Greer, M., Brodison, J., Verghis, R., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20710 · Cited by 48
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Papanastasiou, G. D., Savvides, E. D., Ntzani, E. E., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.019 · Cited by 46
Still no magic bullets: pursuing more rigorous research in quality improvement
Shojania, K. G., & Grimshaw, J. M. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2004.03.003 · Cited by 43
Self-citationDulko, D. (2007) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00098.x · Cited by 38
Bonetti, D., Johnston, M., Pitts, N. B., Deery, C., Ricketts, I., Tilley, C., & Clarkson, J. E. (2009) · International Journal of Behavioral Medicine · doi:10.1007/s12529-008-9017-1 · Cited by 32
Redesigning the ICU nursing discharge process: A quality improvement study.
Chaboyer, W., Lin, F., Foster, M., Retallick, L., Panuwatwanich, K., & Richards, B. (2012) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00234.x · Cited by 33
Mortimer, D., French, S. D., McKenzie, J. E., O′Connor, D. A., & Green, S. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075647 · Cited by 30
Fretheim, A., Oxman, A. D., & Flottorp, S. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-23 · Cited by 26
Self-citationKolehmainen, N., & Francis, J. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-100 · Cited by 24
A Theoretical Lens for Revealing the Complexity of Chronic Care
Borgermans, L., De Maeseneer, J., Wollersheim, H., Vrijhoef, B., & Devroey, D. (2013) · Perspectives in Biology and Medicine · doi:10.1353/pbm.2013.0017 · Cited by 16
Nielsen, S. S., Skou, S. T., Larsen, A. E., Polianskis, R., Pawlak, W. Z., Vægter, H. B., Søndergaard, J., & Christensen, J. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060920 · Cited by 12
Metadata
- Authors
- Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L., Grilli, R., Harvey, E., Oxman, A., & O’Brien, M. A.
- Venue
- Medical Care
- Published
- 2001-08
- Volume
- 39
- Pages
- II-2-II-45
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W4295816668
- Cited by
- 778
- References
- 2
- FWCI
- 60.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.