Effectiveness of Teaching Quality Improvement to Clinicians: A Systematic Review

Abstract

CONTEXT: Accreditation requirements mandate teaching quality improvement (QI) concepts to medical trainees, yet little is known about the effectiveness of teaching QI. OBJECTIVES: To perform a systematic review of the effectiveness of published QI curricula for clinicians and to determine whether teaching methods influence the effectiveness of such curricula. DATA SOURCES: The electronic literature databases of MEDLINE, EMBASE, CINAHL, and ERIC were searched for English-language articles published between January 1, 1980, and April 30, 2007. Experts in the field of QI were queried about relevant studies. STUDY SELECTION: Two independent reviewers selected studies for inclusion if the curriculum taught QI principles to clinicians and the evaluation used a comparative study design. DATA EXTRACTION: Information about the features of each curriculum, its use of 9 principles of adult learning, and the type of educational and clinical outcomes were extracted. The relationship between the outcomes and the number of educational principles used was assessed. RESULTS: Of 39 studies that met eligibility criteria, 31 described team-based projects; 37 combined didactic instruction with experiential learning. The median number of adult learning principles used was 7 (range, 2-8). Evaluations included 22 controlled trials (8 randomized and 14 nonrandomized) and 17 pre/post or time series studies. Fourteen studies described educational outcomes (attitudes, knowledge, or skills or behaviors) and 28 studies described clinical process or patient outcomes. Nine of the 10 studies that evaluated knowledge reported only positive effects but only 2 of these described a validated assessment tool. The 6 assessments of attitudes found mixed results. Four of the 6 studies on skill or behavior outcomes reported only positive effects. Eight of the 28 studies of clinical outcomes reported only beneficial effects. Controlled studies were more likely than other studies to report mixed or null effects. Only 4 studies evaluated both educational and clinical outcomes, providing limited evidence that educational outcomes influence the clinical effectiveness of the interventions. CONCLUSIONS: Most published QI curricula apply sound adult learning principles and demonstrate improvement in learners' knowledge or confidence to perform QI. Additional studies are needed to determine whether educational methods have meaningful clinical benefits.