The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
A meta-analysis of continuing medical education effectiveness
Abstract
INTRODUCTION: We undertook a meta-analysis of the Continuing Medical Education (CME) outcome literature to examine the effect of moderator variables on physician knowledge, performance, and patient outcomes. METHODS: A literature search of MEDLINE and ERIC was conducted for randomized controlled trials and experimental design studies of CME outcomes in which physicians were a major group. CME moderator variables included the types of intervention, the types and number of participants, time, and the number of intervention sessions held over time. RESULTS: Thirty-one studies met the eligibility criteria, generating 61 interventions. The overall sample-size weighted effect size for all 61 interventions was r = 0.28 (0.18). The analysis of CME moderator variables showed that active and mixed methods had medium effect sizes (r = 0.33 [0.33], r = 0.33 [0.26], respectively), and passive methods had a small effect size (r = 0.20 [0.16], confidence interval 0.15, 0.26). There was a positive correlation between the effect size and the length of the interventions (r = 0.33) and between multiple interventions over time (r = 0.36). There was a negative correlation between the effect size and programs that involved multiple disciplines (r = -0.18) and the number of participants (r = -0.13). The correlation between the effect size and the length of time for outcome assessment was negative (r = -0.31). DISCUSSION: The meta-analysis suggests that the effect size of CME on physician knowledge is a medium one; however, the effect size is small for physician performance and patient outcome. The examination of moderator variables shows there is a larger effect size when the interventions are interactive, use multiple methods, and are designed for a small group of physicians from a single discipline.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
(2000) · Cited by 9,198
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development
Knowles, M. S., Holton, E. F., Robinson, P. A., & Caraccioli, C. (2005) · Civil War Book Review · Cited by 2,860
ORGANIZATIONAL CHANGE AND DEVELOPMENT
Weick, K. E., & Quinn, R. E. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.361 · Cited by 2,829
Davis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,847
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Successes and Failures in the Implementation of Evidence-Based Guidelines for Clinical Practice
Grol, R. (2001) · Medical Care · doi:10.1097/00005650-200108002-00003 · Cited by 1,233
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · The Academy of Management Review · doi:10.2307/258247 · Cited by 1,199
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108
The Handbook of Research Synthesis
Hanka, R. (1994) · BMJ · doi:10.1136/bmj.309.6952.488a · Cited by 1,052
How Good Is the Quality of Health Care in the United States?
Schuster, M. A., McGlynn, E. A., & Brook, R. H. (1998) · The Milbank Quarterly · doi:10.1111/1468-0009.00105 · Cited by 908
Meta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792
Rosnow, R. L., & Rosenthal, R. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.4.331 · Cited by 761
Reminders to Physicians from an Introspective Computer Medical Record: A Two-Year Randomized Trial
McDONALD, C. J., HUI, S. L., SMITH, D. M., TIERNEY, W. M., COHEN, S. J., WEINBERGER, M., & McCABE, G. P. (1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-100-1-130 · Cited by 625
(2006) · Educational Researcher · doi:10.3102/0013189x035006033 · Cited by 543
Methods for Integrative Reviews
Jackson, G. B. (1980) · Review of Educational Research · doi:10.2307/1170440 · Cited by 484
Confusion of confidence intervals and credibility intervals in meta-analysis.
Whitener, E. M. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.3.315 · Cited by 432
Implementing guidelines and innovations in general practice: which interventions are effective?
Wensing, M., van der Weijden, T., & Grol, R. P. T. M. (1998) · Europe PMC (PubMed Central) · Cited by 415
The Critical Path to Corporate Renewal
Beer, M., Eisenstat, R. A., & Spector, R. M. (1990) · Medical Entomology and Zoology · Cited by 406
Donmoyer, R. (1992) · Educational Researcher · doi:10.3102/0013189x021004037 · Cited by 348
Impact of Education for Physicians on Patient Outcomes
Clark, N. M., Gong, M., Schork, M. A., Evans, D., Roloff, D., Hurwitz, M., Maiman, L., & Mellins, R. B. (1998) · Pediatrics · doi:10.1542/peds.101.5.831 · Cited by 347
Brown, J. B., Boles, M., Mullooly, J. P., & Levinson, W. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-131-11-199912070-00004 · Cited by 300
Does continuing medical education in general practice make a difference?
Cantillon, P., & Jones, R. (1999) · BMJ · doi:10.1136/bmj.318.7193.1276 · Cited by 289
Continuing medical education: Learning and change: implications for continuing medical education
Fox, R. D., & Bennett, N. L. (1998) · BMJ · doi:10.1136/bmj.316.7129.466 · Cited by 245
Davis, D. (1998) · The International Journal of Psychiatry in Medicine · doi:10.2190/ua3r-jx9w-mhr5-rc81 · Cited by 240
Hodges, B., Inch, C., & Silver, I. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.10.1579 · Cited by 235
Why general practitioners and consultants change their clinical practice: a critical incident study
Allery, L. A., Owen, P. A., & Robling, M. R. (1997) · BMJ · doi:10.1136/bmj.314.7084.870 · Cited by 191
Schneider, B. (2006) · Cited by 149
Bennett, N. L., Davis, D. A., Easterling, W. E., Friedmann, P., Green, J. S., Koeppen, B. M., Mazmanian, P. E., & Waxman, H. S. (2000) · Academic Medicine · doi:10.1097/00001888-200012000-00007 · Cited by 143
Commentary: applying the BMJ's guidelines on educational interventions.
Ker, J. (2000) · PubMed · Cited by 139
van Eijk, M. E. C., Avorn, J., Porsius, A. J., & de Boer, A. (2001) · BMJ · doi:10.1136/bmj.322.7287.654 · Cited by 111
Slotnick, H. B. (1996) · Academic Medicine · doi:10.1097/00001888-199601000-00014 · Cited by 111
ROTER, D. L., Rosenbaum, J., de Negri, B., Renaud, D., DiPrete-Brown, L., & Hernández, O. (1998) · Medical Education · doi:10.1046/j.1365-2923.1998.00196.x · Cited by 109
Majumdar, S. R., Guirguis, L. M., Toth, E. L., Lewanczuk, R. Z., Lee, T. K., & Johnson, J. A. (2003) · Diabetes Care · doi:10.2337/diacare.26.11.3061 · Cited by 101
Doucet, Purdy, Kaufman, & Langille (1998) · Medical Education · doi:10.1046/j.1365-2923.1998.00277.x · Cited by 94
Evaluating an Educational Intervention to Improve the Treatment of Asthma in Four European Countries
Schuiling‐Veninga, C. C. M., ØV, P. L., Wahlström, R., MUSKOVA, M., Denig, P., Berkhof, J. H., Kochen, M. M., & Haaijer‐Ruskamp, F. M. (1999) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.160.4.9812136 · Cited by 86
Carney, P. A., Dietrich, A. J., Freeman, D. H., & Mott, L. A. (1995) · Academic Medicine · doi:10.1097/00001888-199501000-00014 · Cited by 76
Can Internet-based education improve physician confidence in dealing with domestic violence?
Harris, J. M., Kutob, R. M., Surprenant, Z. J., Maiuro, R. D., & Delate, T. (2002) · PubMed · Cited by 75
Modell, M., Wonke, B., Anionwu, E. N., Khan, M., Tai, S. S., Lloyd, M., & Modell, B. (1998) · BMJ · doi:10.1136/bmj.317.7161.788 · Cited by 75
Chan, D., Leclair, K., & Kaczorowski, J. A. (1999) · PubMed · Cited by 71
The continuing professional development of physicians: from research to practice
Collins, J. (2004) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2003.12.038 · Cited by 71
Improving drug use through continuing education: A randomized controlled trial in Zambia
Bexell, A., Lwando, E., von Hofsten, B., Tembo, S., Eriksson, B., & Diwan, V. K. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00059-3 · Cited by 64
White, C. W., ALBANESE, M. A., BROWN, D. D., & CAPLAN, R. M. (1985) · Annals of Internal Medicine · doi:10.7326/0003-4819-102-5-686 · Cited by 61
Evaluation of a training package in the assessment and management of depression in primary care
Gask, L. L., Usherwood, T. P., Thompson, H., & Williams, B. (1998) · Medical Education · doi:10.1046/j.1365-2923.1998.00195.x · Cited by 61
The effectiveness of continuing medical education: A quantitative synthesis
Beaudry, J. S. (1989) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.4750090414 · Cited by 61
The Continuing Professional Development of Physicians: From Research to Practice
Barnes, B., Davis, D. A., & Davis, D. (2003) · Cited by 56
Nilsson, G. H., Hjemdahl, P., Hassler, A., Vitols, S., Wallén, N. H., & Krakau, I. (2001) · European Journal of Clinical Pharmacology · doi:10.1007/s002280000242 · Cited by 55
Fender, G., Prentice, A., Gorst, T., Nixon, R. M., Duffy, S. W., Day, N., & Smith, S. K. (1999) · BMJ · doi:10.1136/bmj.318.7193.1246 · Cited by 53
Socolar, R. R. S., Raines, B., Chen-Mok, M., Runyan, D. K., Green, C. L., & Paterno, S. M. (1998) · PEDIATRICS · doi:10.1542/peds.101.5.817 · Cited by 46
Outreach Education to Improve Quality of Rural ICU Care: Results of a Randomized Trial
HENDRYX, M. S., Fieselmann, J. F., BOCK, M. J., Wakefield, D. S., Helms, C. M., & Bentler, S. (1998) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.158.2.9608068 · Cited by 43
A Randomized Controlled Trial to Change Antibiotic Prescribing Patterns in a Community
Doyne, E. O., Alfaro, M. P., Siegel, R., Atherton, H. D., Schoettker, P. J., Bernier, J., & Kotagal, U. R. (2004) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.158.6.577 · Cited by 43
Primary care physicians and their information-seeking behaviour
Nylenna, O. G. A. M. (2000) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813430050202488 · Cited by 41
Dolan, N. C., Ng, J. S., Martin, G. J., Robinson, J. K., & RADEMAKER, A. W. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.07106.x · Cited by 40
Gerstein, H. C., Reddy, S. S. K., Dawson, K. G., Yale, J., Shannon, S., & Norman, G. R. (1999) · Diabetic Medicine · doi:10.1046/j.1464-5491.1999.00159.x · Cited by 37
Influencing the prescribing behaviour of physicians: a metaevaluation
Pippalla, R. S., Riley, D. A., & Chinburapa, V. (1995) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/j.1365-2710.1995.tb00648.x · Cited by 30
Participation in CME activities.
Goulet, F., Gagnon, R. J., Desrosiers, G., Jacques, A., & Sindon, A. (1998) · PubMed Central · Cited by 29
Does a teaching programme improve general practitioners' management of depression in the elderly?
Butler, R., Collins, E., Katona, C., & Orrell, M. W. (1997) · Journal of Affective Disorders · doi:10.1016/s0165-0327(97)00154-7 · Cited by 27
Continuing medical education and attitudes of health care providers toward treating diabetes
Sharp, L. K., & Lipsky, M. S. (2002) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340220206 · Cited by 22
Weller, D. (2003) · Family Practice · doi:10.1093/fampra/cmg606 · Cited by 22
Scardovi, A., Rucci, P., Gask, L., et al. (2003) · Family Practice · doi:10.1093/fampra/cmg404 · Cited by 20
Labelle, M., Beaulieu, M., RENZI, P. M., Rahme, E., & Thivierge, R. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240107 · Cited by 19
Markert, R. J., O’Neill, S., & Bhatia, S. C. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230306 · Cited by 10
Cited by
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Cervero, R. M., & Gaines, J. K. (2015) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21290 · Cited by 515
Surr, C. A., Gates, C., Irving, D., Oyebode, J., Smith, S. J., Parveen, S., Drury, M., & Dennison, A. (2017) · Review of Educational Research · doi:10.3102/0034654317723305 · Cited by 327
Effective in-service training design and delivery: evidence from an integrative literature review
Bluestone, J., Johnson, P., Fullerton, J., Carr, C., Alderman, J., & BonTempo, J. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-51 · Cited by 329
The effectiveness of knowledge translation strategies used in public health: a systematic review
LaRocca, R., Yost, J., Dobbins, M., Ciliska, D., & Butt, M. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-751 · Cited by 300
Metadata
- Authors
- Mansouri, M., & Lockyer, J.
- Venue
- Journal of Continuing Education in the Health Professions
- Published
- 2007
- Volume
- 27
- Issue
- 1
- Pages
- 6-15
- ISSN
- 0894-1912 (ISSN-L)
- OpenAlex
- W2047475314
- Cited by
- 437
- References
- 71
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.