The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Changing Physician Performance: A Systematic Review of the Effect of Continuing Medical Education Strategies
Abstract
Objective. —To review the literature relating to the effectiveness of education strategies designed to change physician performance and health care outcomes. Data Sources. —We searched MEDLINE, ERIC, NTIS, the Research and Development Resource Base in Continuing Medical Education, and other relevant data sources from 1975 to 1994, usingcontinuing medical education(CME) and related terms as keywords. We manually searched journals and the bibliographies of other review articles and called on the opinions of recognized experts. Study Selection. —We reviewed studies that met the following criteria: randomized controlled trials of education strategies or interventions that objectively assessed physician performance and/or health care outcomes. These intervention strategies included (alone and in combination) educational materials, formal CME activities, outreach visits such as academic detailing, opinion leaders, patient-mediated strategies, audit with feedback, and reminders. Studies were selected only if more than 50% of the subjects were either practicing physicians or medical residents. Data Extraction. —We extracted the specialty of the physicians targeted by the interventions and the clinical domain and setting of the trial. We also determined the details of the educational intervention, the extent to which needs or barriers to change had been ascertained prior to the intervention, and the main outcome measure(s). Data Synthesis. —We found 99 trials, containing 160 interventions, that met our criteria. Almost two thirds of the interventions (101 of 160) displayed an improvement in at least one major outcome measure: 70% demonstrated a change in physician performance, and 48% of interventions aimed at health care outcomes produced a positive change. Effective change strategies included reminders, patient-mediated interventions, outreach visits, opinion leaders, and multifaceted activities. Audit with feedback and educational materials were less effective, and formal CME conferences or activities, without enabling or practice-reinforcing strategies, had relatively little impact. Conclusion. —Widely used CME delivery methods such as conferences have little direct impact on improving professional practice. More effective methods such as systematic practice-based interventions and outreach visits are seldom used by CME providers. (JAMA. 1995;274:700-705)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A number of studies [4-6,26,78-80] have clearly demonstrated that education alone has a limited impact on changing healthcare professionals’ clinical practices and behaviours.”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [79]
In the citing paper
“However, much of the work examining health practitioner behaviour change has, to date, been largely atheoretical [11-14].”
Citations
Cites
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Tierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Improving treatment of late life depression in primary care: a randomized clinical trial
Callahan, C. M., Hendrie, H. C., Dittus, R. S., Brater, D. C., Hui, S. L., & Tierney, W. M. (1994) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1994.tb06555.x · Cited by 304
Magruder-Habib, K., Zung, W. W. K., & Feussner, J. R. (1990) · Medical Care · doi:10.1097/00005650-199003000-00004 · Cited by 163
Cited by
Sorted by citations
Lost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Meschia, J. F., Bushnell, C., Boden-Albala, B., Braun, L. T., Bravata, D. M., Chaturvedi, S., Creager, M. A., Eckel, R. H., Elkind, M. S. V., Fornage, M., et al. (2014) · Stroke · doi:10.1161/str.0000000000000046 · Cited by 2,650
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Davis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
Self-citationWhat drives change? Barriers to and incentives for achieving evidence‐based practice
Grol, R., & Wensing, M. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05948.x · Cited by 1,378
Ferlie, E. B., & Shortell, S. M. (2001) · The Milbank Quarterly · doi:10.1111/1468-0009.00206 · Cited by 1,335
Phillips, L. S., Branch, W. T., Cook, C. B., Doyle, J. P., El-Kebbi, I. M., Gallina, D. L., Miller, C. D., Ziemer, D. C., & Barnes, C. S. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-9-200111060-00012 · Cited by 1,370
Goldstein, L. B., Bushnell, C. D., Adams, R. J., Appel, L. J., Braun, L. T., Chaturvedi, S., Creager, M. A., Culebras, A., Eckel, R. H., Hart, R. G., et al. (2011) · Stroke · doi:10.1161/str.0b013e3181fcb238 · Cited by 1,306
How Can Research Organizations More Effectively Transfer Research Knowledge to Decision Makers?
LAVIS, J. N., ROBERTSON, D., WOODSIDE, J. M., McLEOD, C. B., & ABELSON, J. (2003) · The Milbank Quarterly · doi:10.1111/1468-0009.t01-1-00052 · Cited by 1,176
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
How Can We Increase Translation of Research into Practice? Types of Evidence Needed
Glasgow, R. E., & Emmons, K. M. (2007) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144145 · Cited by 1,050
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
Getting evidence into practice: the role and function of facilitation
Harvey, G., Loftus‐Hills, A., Rycroft‐Malone, J., Titchen, A., Kitson, A., McCormack, B., & Seers, K. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.02126.x · Cited by 730
An overview of clinical research: the lay of the land
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07283-5 · Cited by 734
Professional development in early childhood programs: Process issues and research needs
Sheridan, S. M., Edwards, C. P., Marvin, C. A., & Knoche, L. L. (2009) · Early Education and Development · doi:10.1080/10409280802582795 · Cited by 537
Gaps between knowing and doing: Understanding and assessing the barriers to optimal health care
Cochrane, L. J., Olson, C. A., Murray, S., Dupuis, M., Tooman, T., & Hayes, S. (2007) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.106 · Cited by 500
Kiefe, C. I., Allison, J. J., Williams, O. D., Person, S. D., Weaver, M. T., & Weissman, N. W. (2001) · JAMA · doi:10.1001/jama.285.22.2871 · Cited by 503
Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006) · Medical Teacher · doi:10.1080/01421590600622665 · Cited by 500
Soumerai, S. B., McLaughlin, T. J., Gurwitz, J. H., Guadagnoli, E., Hauptman, P. J., Borbas, C., Morris, N., McLaughlin, B., Gao, X., Willison, D. J., et al. (1998) · JAMA · doi:10.1001/jama.279.17.1358 · Cited by 479
Conceptual frameworks to illuminate and magnify
Bordage, G. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03295.x · Cited by 479
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
Bornstein, B. H., & Emler, A. C. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00284.x · Cited by 353
Evaluating informatics applications – clinical decision support systems literature review
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00183-6 · Cited by 350
Systematic review of knowledge translation strategies in the allied health professions
Scott, S. D., Albrecht, L., O’Leary, K., Ball, G. D., Hartling, L., Hofmeyer, A., Jones, C. A., Klassen, T. P., Burns, K. K., Newton, A. S., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-70 · Cited by 331
Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009993 · Cited by 254
“Previous literature had suggested that multifaceted strategies could be more effective than single strategies, 94 97 98 and their use was advocated in the 2008 Medical Research Council (MRC) complex intervention guidance as potentially useful approaches to implementation.”
Ford, E. W., Menachemi, N., & Phillips, M. T. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1913 · Cited by 275
Menon, A., Korner-Bitensky, N., Kastner, M., McKibbon, K., & Straus, S. (2009) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-0451 · Cited by 260
O’Donovan, R., & McAuliffe, E. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4931-2 · Cited by 259
Suicide and violence prevention: Parent education in the emergency department
Kruesi, M. J. P., Grossman, J., Pennington, J. M., Woodward, P. J., Duda, D., & Hirsch, J. G. (1999) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199903000-00010 · Cited by 251
the Canada PRIME Plus Team, Patey, A. M., Islam, R., Francis, J. J., Bryson, G. L., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-52 · Cited by 237
Translating what we have learned into practice
Glasgow, R. E., Goldstein, M. G., Ockene, J. K., & Pronk, N. P. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.04.019 · Cited by 239
Designing a quality improvement intervention: a systematic approach
van Bokhoven, M. A. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.3.215 · Cited by 204
Lyon, A. R., Stirman, S. W., Kerns, S. E. U., & Bruns, E. J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0331-y · Cited by 210
Figueiras, A., Herdeiro, M. T., Polónia, J., & Gestal-Otero, J. J. (2006) · JAMA · doi:10.1001/jama.296.9.1086 · Cited by 204
Nadler, M., Bainbridge, D., Tomasone, J., Cheifetz, O., Juergens, R. A., & Sussman, J. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-017-3640-9 · Cited by 190
Interventions to Improve Chronic Illness Care: Evaluating Their Effectiveness
Bodenheimer, T. (2003) · Disease Management · doi:10.1089/109350703321908441 · Cited by 189
Continuing Medical Education Effect on Practice Performance
Davis, D., & Galbraith, R. (2009) · Chest · doi:10.1378/chest.08-2517 · Cited by 172
Self-citationKroenke, K., Taylor-Vaisey, A., Dietrich, A. J., & Oxman, T. E. (2000) · Psychosomatics · doi:10.1016/s0033-3182(00)71172-8 · Cited by 164
Foy, R. (2003) · Family Practice · doi:10.1093/fampra/20.1.83 · Cited by 160
A clinical trial of tailored office systems for preventive service delivery
Goodwin, M. A., Zyzanski, S. J., Zronek, S., Ruhe, M., Weyer, S. M., Konrad, N., Esola, D., & Stange, K. C. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00310-5 · Cited by 144
Impact studies in continuing education for health professions: update
Robertson, M. K., Umble, K. E., & Cervero, R. M. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230305 · Cited by 145
Bekkering, G. E., van Tulder, M. W., Hendriks, E. J., Koopmanschap, M. A., Knol, D. L., Bouter, L. M., & Oostendorp, R. A. (2005) · Physical Therapy · doi:10.1093/ptj/85.6.544 · Cited by 141
Bekkering, G. E. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.009357 · Cited by 138
Commitment to change statements can predict actual change in practice.
Wakefield, J., Herbert, C. P., Maclure, M., Dormuth, C., Wright, J. M., Legare, J., Brett-MacLean, P., & Premi, J. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230205 · Cited by 141
What do we know about how dentists make caries-related treatment decisions?
Bader, J. D., & Shugars, D. A. (1997) · Community Dentistry and Oral Epidemiology · doi:10.1111/j.1600-0528.1997.tb00905.x · Cited by 128
Developing a theory‐based taxonomy of methods for implementing change in practice
Leeman, J., Baernholdt, M., & Sandelowski, M. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.04207.x · Cited by 120
Human Factors Barriers to the Effective Use of Ten HIV Clinical Reminders
Patterson, E. S., Nguyen, A. D., Halloran, J. P., & Asch, S. M. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1364 · Cited by 115
Task force 8. Organization of preventive cardiology service
Pearson, T. A., McBride, P. E., Miller, N. H., & Smith, S. C. (1996) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(96)87736-9 · Cited by 110
Personality Traits in Juvenile Delinquents: Relation to Criminal Behavior and Recidivism
Steiner, H., Cauffman, E., & Duxbury, E. (1999) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199903000-00011 · Cited by 109
Phillips, L. S., Ziemer, D. C., Doyle, J. P., Barnes, C. S., Kolm, P., Branch, W. T., Caudle, J. M., Cook, C. B., Dunbar, V. G., El-Kebbi, I. M., et al. (2005) · Diabetes Care · doi:10.2337/diacare.28.10.2352 · Cited by 108
Maloney, S., Haas, R., Keating, J. L., Molloy, E., Jolly, B., Sims, J., Morgan, P., & Haines, T. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2040 · Cited by 107
Rebbeck, T., Maher, C. G., & Refshauge, K. M. (2006) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(06)70025-3 · Cited by 102
Physician advice about smoking and drinking
Denny, C. H., Serdula, M. K., Holtzman, D., & Nelson, D. E. (2003) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00568-8 · Cited by 102
Two-year effects of quality improvement programs on medication management for depression
Unützer, J., Rubenstein, L., Katon, W. J., Tang, L., Duan, N., Lagomasino, I. T., & Wells, K. B. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.10.935 · Cited by 102
Pierce, D., Liaw, S.-T., Dobell, J., & Anderson, R. (2010) · International Journal of Mental Health Systems · doi:10.1186/1752-4458-4-10 · Cited by 100
Herbert, C. P. (2004) · Family Practice · doi:10.1093/fampra/cmh515 · Cited by 83
Maloney, S., Storr, M., Paynter, S., Morgan, P., & Ilic, D. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9355-2 · Cited by 74
Rosenbloom, S. T., Geissbuhler, A. J., Dupont, W. D., Giuse, D. A., Talbert, D. A., Tierney, W. M., Plummer, W. D., Stead, W. W., & Miller, R. A. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1627 · Cited by 71
Kaner, E., Lock, C., Heather, N., McNamee, P., & Bond, S. (2003) · Patient Education and Counseling · doi:10.1016/s0738-3991(02)00242-2 · Cited by 71
Nilsen, P., Kaner, E., & Babor, T. F. (2008) · Nordic Studies on Alcohol and Drugs · doi:10.1177/145507250802500608 · Cited by 64
Lindner, S. A., Ben Davoren, J., Vollmer, A., Williams, B., & Seth Landefeld, C. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01214.x · Cited by 61
Hoeijenbos, M., Bekkering, T., Lamers, L., Hendriks, E., van Tulder, M., & Koopmanschap, M. (2005) · Health Policy · doi:10.1016/j.healthpol.2005.02.008 · Cited by 61
Brown, C. J., Gottschalk, M., Van Ness, P. H., Fortinsky, R. H., & Tinetti, M. E. (2005) · Physical Therapy · doi:10.1093/ptj/85.5.394 · Cited by 52
Wiener-Ogilvie, S., Huby, G., Pinnock, H., Gillies, J., & Sheikh, A. (2008) · BMC Family Practice · doi:10.1186/1471-2296-9-32 · Cited by 48
McClellan, W. M., Hodgin, E., Pastan, S., McAdams, L., & Soucie, M. (2004) · Journal of the American Society of Nephrology · doi:10.1097/01.asn.0000115701.51613.d7 · Cited by 40
Byng, R., & Jones, R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2003.00439.x · Cited by 31
Baker, R., Farooqi, A., Tait, C., & Walsh, S. (1997) · Quality and Safety in Health Care · doi:10.1136/qshc.6.1.14 · Cited by 28
A Randomized Trial of Evidence-Based Outreach (EBOR)
Freemantle, N., Eccles, M., Wood, J., Mason, J., Nazareth, I., Duggan, C., Young, P., Haines, A., Drummond, M., Russell, I., et al. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00023-9 · Cited by 25
Sauaia, A., Ralston, D., Schluter, W. W., Marciniak, T. A., Havranek, E. P., & Dunn, T. R. (2000) · American Journal of Medical Quality · doi:10.1177/106286060001500503 · Cited by 24
Themed Review: Clinical Interventions to Promote Physical Activity in Youth
Meriwether, R. A., Lobelo, F., & Pate, R. R. (2008) · American Journal of Lifestyle Medicine · doi:10.1177/1559827607308557 · Cited by 22
Hayes, R. P., Baker, D. W., Luthi, J.-C., Baggett, R. L., McClellan, W., Fitzgerald, D., Abrams, F. R., Bratzler, D., & Ballard, D. J. (2002) · American Journal of Medical Quality · doi:10.1177/106286060201700605 · Cited by 15
Fjortoft, N. (2007) · American Journal of Pharmaceutical Education · doi:10.5688/aj7106112 · Cited by 11
Metadata
- Authors
- Davis, D. A.
- Corresponding author
- Davis, David A.
- ORCID
- Davis, David A.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 1995-09-06
- Volume
- 274
- Issue
- 9
- Pages
- 700
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W4249753019
- Cited by
- 1,763
- References
- 4
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 20 · 2023: 20 · 2022: 23 · 2021: 36 · 2020: 26 · 2019: 32 · 2018: 34 · 2017: 47 · 2016: 58 · 2015: 43 · 2014: 50 · 2013: 49 · 2012: 60
- FWCI
- 69.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- continuing medical education, physician performance, health care outcomes, educational intervention, academic detailing, opinion leaders, reminders, teaching materials, practice-based interventions, multicomponent intervention, barriers to change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review