The DOI matches its Crossref record; 62 of the 63 references it cites were found in a registry or an index.
Printed educational materials: effects on professional practice and health care outcomes
Abstract
BACKGROUND: Printed educational materials (PEMs) are widely used passive dissemination strategies to improve knowledge, awareness, attitudes, skills, professional practice and patient outcomes. Traditionally they are presented in paper formats such as monographs, publication in peer-reviewed journals and clinical guidelines and appear to be the most frequently adopted method for disseminating information. OBJECTIVES: To determine the effectiveness of PEMs in improving process outcomes (including the behaviour of healthcare professionals) and patient outcomes. To explore whether the effect of characteristics of PEMs (e.g., source, content, format, mode of delivery, timing/frequency, complexity of targeted behaviour change) can influence process outcomes (including the behaviour of healthcare professionals and patient outcomes). SEARCH STRATEGY: The following electronic databases were searched up to July 2006: (a) The EPOC Group Specialised Register (including the database of studies awaiting assessment (see 'Specialised Register'under 'Group Details'); (b) The Cochrane Central Register of Controlled Trials (CENTRAL) and the Database of Abstracts of Reviews of Effectiveness; (c) MEDLINE, EMBASE, CINAHL and CAB Health. An updated search of MEDLINE was done in March 2007. SELECTION CRITERIA: We included randomised controlled trials (RCTs) , controlled clinical trials (CCT), controlled before and after studies (CBAs) and interrupted time series analyses (ITS) that evaluated the impact of printed educational materials on healthcare professionals' practice and/or patient outcomes. There was no language restriction. Any objective measure of professional performance (sch as number of tests ordered, prescriptions for a particular drug), or patient health outcomes (e.g., blood pressure, number of caesarean sections) were included. DATA COLLECTION AND ANALYSIS: Four reviewers undertook data abstraction independently using a modified version of the EPOC data collection checklist. Any disagreement was resolved by discussion among the reviewers and arbitrators. Statistical analysis was based upon consideration of dichotomous process outcomes, continuous process outcomes, patient outcome dichotomous measures and patient outcome continuous measures. We presented the results for all comparisons using a standard method of presentation where possible. We reported separately for each study the median effect size for each type of outcome, and the median of these effect sizes across studies. MAIN RESULTS: Twenty-three studies were included for this review. Evidence from this review showed that PEMs appear to have small beneficial effects on professional practice. RCTs comparing PEMs to no intervention observed an absolute risk difference median: +4.3% on categorical process outcomes (e.g., x-ray requests, prescribing and smoking cessation activities) (range -8.0% to +9.6%, 6 studies), and a relative risk difference +13.6% on continuous process outcomes (e.g., medication change, x-rays requests per practice) (range -5.0% to +26.6%, 4 studies). These findings are similar to those reported for the ITS studies, although significantly larger effect sizes were observed (relative risk difference range from 0.07% to 31%). In contrast, the median effect size was -4.3% for patient outcome categorical measures (e.g., screening, return to work, quit smoking) (range -0.4% to -4.6%, 3 studies)). Two studies reported deteriorations in continuous patient outcome data (e.g., depression score, smoking cessation attempts) of -10.0% and -20.5%. One study comparing PEMs with educational workshops observed minimal differences. Two studies comparing PEMs and education outreach did not have statistically significant differences between the groups. It was not possible to explore potential effect modifiers across studies. AUTHORS' CONCLUSIONS: The results of this review suggest that when compared to no intervention, PEMs when used alone may have a beneficial effect on process outcomes but not on patient outcomes. Despite this wide of range of effects reported for PEMs, clinical significance of the observed effect sizes is not known. There is insufficient information about how to optimise educational materials. The effectiveness of educational materials compared to other interventions is uncertain.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“passive absorption of knowledge usually either does not work or is very slow.”
From Translating research into everyday clinical practice: Lessons learned from a USA dental practice-based research network (2013) · cites this paper as [77]
In the citing paper
“passive dissemination of knowledge, guidelines, and attendance at meetings are not necessarily effective for the translation of research into practice [77].”
From Translating research into everyday clinical practice: Lessons learned from a USA dental practice-based research network (2013) · cites this paper as [77]
In the citing paper
“However, recent reviews (Farmer 2008; Grimshaw 2004) found that printed educational materials have a small (but potentially important) effect.”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Farmer 2008
Citations
Cites
1 retracted
Printed educational materials: effects on professional practice and health care outcomes
Freemantle, N., Harvey, E., Wolf, F. M., Grimshaw, J., Grilli, R. G., & Bero, L. A. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000172 · Cited by 348
Self-citationRetractedIn search of how people change: Applications to addictive behaviors.
Prochaska, J. O., DiClemente, C. C., & Norcross, J. C. (1992) · American Psychologist · doi:10.1037/0003-066x.47.9.1102 · Cited by 8,596
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Self-citationEffect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,791
Self-citationHayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,771
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Self-citationDavis, D., O'Brien, M. A. T., Freemantle, N., Wolf, F. M., Mazmanian, P., & Taylor-Vaisey, A. (1999) · JAMA · doi:10.1001/jama.282.9.867 · Cited by 2,364
Self-citation(2001) · PubMed · Cited by 1,709
Self-citation(1999) · Cited by 1,648
Do Practice Guidelines Guide Practice?
Lomas, J., Anderson, G. M., Pierre, K. D., Vayda, E., Enkin, M. W., & Hannah, W. J. (1989) · New England Journal of Medicine · doi:10.1056/nejm198911093211906 · Cited by 1,231
Ukoumunne, Gulliford, M. C., Chinn, Sterne, & Burney, P. (1999) · Health Technology Assessment · doi:10.3310/hta3050 · Cited by 1,211
Believe it or not: Factors influencing credibility on the Web
Wathen, C. N., & Burkell, J. (2001) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10016 · Cited by 1,171
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877
Improving Drug-Therapy Decisions through Educational Outreach
Avorn, J., & Soumerai, S. B. (1983) · New England Journal of Medicine · doi:10.1056/nejm198306163082406 · Cited by 858
Ramsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000576 · Cited by 703
Self-citationCredibility and computing technology
Tseng, S., & Fogg, B. J. (1999) · Communications of the ACM · doi:10.1145/301353.301402 · Cited by 591
Some Statistical Methods for Combining Experimental Results
Laird, N. M., & Mosteller, F. C. (1990) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300008916 · Cited by 564
The Awareness-to-Adherence Model of the Steps to Clinical Guideline Compliance
Pathman, D. E., Konrad, T. R., Freed, G. L., Freeman, V. A., & Koch, G. G. (1996) · Medical Care · doi:10.1097/00005650-199609000-00002 · Cited by 499
Public communication campaigns
OECD (2024) · Government at glance. · doi:10.1787/77f3b4ba-en · Cited by 445
Internists' Attitudes about Clinical Practice Guidelines
Tunis, S., Hayward, R. S. A., Wilson, M. C., Rubin, H. R., Bass, E. B., Johnston, M., & Steinberg, E. P. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-11-199406010-00008 · Cited by 440
Diffusion, Dissemination, and Implementation: Who Should Do What?
LOMAS, J. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26351.x · Cited by 397
Grilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392
Toward a Comprehensive Interdisciplinary Model of Health Care Research Use
Logan, J., & Graham, I. D. (1998) · Science Communication · doi:10.1177/1075547098020002004 · Cited by 347
Kreuter, M. W., & Strecher, V. J. (1996) · Health Education Research · doi:10.1093/her/11.1.97 · Cited by 305
Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., et al. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04564-5 · Cited by 222
Self-citationKetley, D., & WOODS, K. L. (1993) · The Lancet · doi:10.1016/0140-6736(93)91945-i · Cited by 212
Revere, D., & Dunbar, P. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080062 · Cited by 208
How doctors learn: physicians' self-directed learning episodes.
Slotnick, H. (1999) · Academic medicine : journal of the Association of American Medical Colleges · doi:10.1097/00001888-199910000-00014 · Cited by 192
Foy, R., MacLennan, G., Grimshaw, J., Penney, G., Campbell, M., & Grol, R. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00403-1 · Cited by 185
Self-citationA Randomized Trial to Increase Smoking Intervention by Physicians
Kottke, T. E. (1989) · JAMA · doi:10.1001/jama.261.14.2101 · Cited by 185
Promotion and Prescribing of Hormone Therapy After Report of Harm by the Women’s Health Initiative
Majumdar, S. R. (2004) · JAMA · doi:10.1001/jama.292.16.1983 · Cited by 171
Economic and Policy Analysis of University-based Drug ???Detailing???
Soumerai, S. B., & Avorn, J. (1986) · Medical Care · doi:10.1097/00005650-198604000-00003 · Cited by 166
KULKARNI, K., CASTLE, G., GREGORY, R., HOLMES, A., LEONTOS, C., POWERS, M., SNETSELAAR, L., SPLETT, P., & WYLIE-ROSETT, J. (1998) · Journal of the American Dietetic Association · doi:10.1016/s0002-8223(98)00017-0 · Cited by 158
(2001) · Journal of Health Communication · doi:10.1080/108107301752384442 · Cited by 131
Engers, A. J., Wensing, M., van Tulder, M. W., Timmermans, A., Oostendorp, R. A. B., Koes, B. W., & Grol, R. (2005) · Spine · doi:10.1097/01.brs.0000155406.79479.3a · Cited by 113
Oakeshott, P., Kerry, S., & Williams, J. E. F. (1994) · PubMed · Cited by 102
Provider Education To Promote Implementation of Clinical Practice Guidelines
Ockene, J. K., & Zapka, J. G. (2000) · CHEST Journal · doi:10.1378/chest.118.2_suppl.33s · Cited by 90
Croudace, T. J., Evans, J., Harrison, G. L., Sharp, D. J., Wilkinson, E., McCann, G., Spence, M., Crilly, C., & Brindle, L. A. (2003) · The British Journal of Psychiatry · doi:10.1192/bjp.182.1.20 · Cited by 85
Matowe, L. K., Ramsay, C. R., Grimshaw, J., Gilbert, F. J., MacLeod, M. J., & Needham, G. (2002) · Clinical Radiology · doi:10.1053/crad.2001.0894 · Cited by 78
Self-citationMajumdar, S. R., McAlister, F. A., & Soumerai, S. B. (2003) · The American Journal of Medicine · doi:10.1016/s0002-9343(03)00422-4 · Cited by 77
Kaner, E., Lock, C., Heather, N., McNamee, P., & Bond, S. (2003) · Patient Education and Counseling · doi:10.1016/s0738-3991(02)00242-2 · Cited by 71
Dissemination of effectiveness and outcomes research
Kanouse, D. E., Kallich, J. D., & Kahan, J. P. (1995) · Health Policy · doi:10.1016/0168-8510(95)00760-1 · Cited by 70
The impact of reading on physicians' nonadherence to recommended standards of medical care
Cohen, S. J., Weinberger, M., Hui, S. L., Tierney, W. M., & McDonald, C. J. (1985) · Social Science & Medicine · doi:10.1016/0277-9536(85)90147-9 · Cited by 63
Azocar, F., Cuffel, B., Goldman, W., & McCarter, L. (2005) · Journal of Behavioral Health Services & Research · doi:10.1007/bf02287816 · Cited by 61
Ferrari, R. R., Rowe, B. H., Majumdar, S. R., Cassidy, J. D., Blitz, S., Wright, S. C., & RUSSELL, A. S. (2005) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2005.tb00936.x · Cited by 53
Disseminating healthcare information: getting the message across
Marriott, S., Palmer, C., & Lelliott, P. (2000) · BMJ Quality & Safety · doi:10.1136/qhc.9.1.58 · Cited by 51
Denig, P., Haaijer‐Ruskamp, F. M., & ZIJSLING, D. H. (1990) · DICP · doi:10.1177/106002809002400116 · Cited by 50
Lennox, A. S., Bain, N., Taylor, R. J., McKie, L. J., Donnan, P. T., & Groves, J. (1998) · Health Education Journal · doi:10.1177/001789699805700206 · Cited by 46
Hazard, R. G., Haugh, L. D., Reid, S., McFarlane, G., & MacDonald, L. (1997) · Spine · doi:10.1097/00007632-199712150-00019 · Cited by 43
Mason, J. M., Freemantle, N., & Browning, G. G. (2001) · BMJ · doi:10.1136/bmj.323.7321.1096 · Cited by 42
Dormuth, C. R. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1031621 · Cited by 42
Légaré, F., Godin, G., Ringa, V., Dodin, S., Turcot, L., & Norton, J. L. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-31 · Cited by 36
Self-citationUnderstanding physicians’ intention to use a simple infection control measure: Wearing gloves
Godin, G., Naccache, H., & Fortin, C. (1998) · American Journal of Infection Control · doi:10.1016/s0196-6553(98)70037-9 · Cited by 35
Austin, P. C., & Mamdani, M. (2005) · Circulation · doi:10.1161/circulationaha.104.531582 · Cited by 32
Chest radiography guidelines for general practitioners: A practical approach
Bearcroft, P. W. P., Small, J., & Flower, C. D. R. (1994) · Clinical Radiology · doi:10.1016/s0009-9260(05)82916-2 · Cited by 28
Reduction in the use of surgery for glue ear: did national guidelines have an impact?
Black, N. A. (2002) · BMJ Quality & Safety · doi:10.1136/qhc.11.2.121 · Cited by 27
Bjornson, L. D. C., Rector, T. S., Daniels, C. E., Wertheimer, A. I., Snowdon, D. A., & Litman, T. J. (1990) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/47.7.1541 · Cited by 22
Impact of local evidence-based clinical guidelines--a Danish intervention study
Steffensen, F. H. (1997) · Family Practice · doi:10.1093/fampra/14.3.209 · Cited by 20
The Effect of the ACOG Guideline on Vaginal Births after Cesarean
Santerre, R. E. (1996) · Medical Care Research and Review · doi:10.1177/107755879605300306 · Cited by 17
Beaulieu, M., Brophy, J. M., Jacques, A., Blais, R., Battista, R. N., & Lebeau, R. (2003) · QJM · doi:10.1093/qjmed/hch006 · Cited by 17
The investigation of chest pain: audit and intervention
Ratnaike, S., Hunt, D. U., Eilermann, L. J. M., Hazen, R., & Deam, D. R. (1993) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1993.tb138081.x · Cited by 14
The impact of the Women's Health Initiative study on incident clonidine use in Ontario, Canada.
Austin, P. C., Mamdani, M., & Tu, K. (2004) · PubMed · Cited by 7
Flagged first, then by citations
1 of the 63 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Kottke, 1989, Use smoking intervention by physicians. Doctors Helping Smokers, Round I, JAMA, 261, 2101, 10.1001/jama.1989.03420140103035 · DOI
- Mason, The effect of the distribution of Effective Health Care Bulletins on prescribing selective serotonin reuptake inhibitors in primary care, Health Trends, 30, 120
- Berbatis, 1982, Impact of a drug bulletin on prescribing analgesics in a teaching hospital, American Journal of Hospital Pharmacy, 39, 98
- Azjen, 1980, Understanding behavior and predicting social behavior
- Burgers, 2003, Characteristics of effective guidelines for general practice, British Journal of General Practice, 53, 15
- McGuire, 1989, Theoretical foundations of campaigns
Cited by
Sorted by citations
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationKnowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Self-citationPrinted educational materials: effects on professional practice and healthcare outcomes
Giguere, A. M. C., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso‐Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 904
Self-citationInterventions for improving the adoption of shared decision making by healthcare professionals
Légaré, F., Ratté, S., Stacey, D., Kryworuchko, J., Gravel, K., Graham, I. D., & Turcotte, S. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006732.pub2 · Cited by 832
Self-citationEnhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
Metadata
- Authors
- Farmer, A. P., Légaré, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J., & Wolf, F. M.
- Affiliations
- University of Alberta (CA)
- Hôpital Saint-François d'Assise (CA)
- Centre hospitalier universitaire de Québec (CA)
- University of Ottawa (CA)
- University of Washington (US)
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- John Wiley & Sons, Ltd
- Published
- 2008-07-16
- Issue
- 3
- Pages
- CD004398-CD004398
- ISSN
- 1361-6137 (ISSN-L)
- OpenAlex
- W2595809667
- Cited by
- 249
- References
- 63
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 7 · 2021: 10 · 2020: 7 · 2019: 16 · 2018: 17 · 2017: 8 · 2016: 10 · 2015: 9 · 2014: 14 · 2013: 34 · 2012: 28
- Type
- reference entry
- Language
- en
- Update notices
- new_version (2012-10-17)
- Open access
- closed
- Locations
- Cochrane Database of Systematic Reviews (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- printed educational materials, professional practice change, healthcare workers, patient outcomes, clinical guidelines, prescribing behaviour, smoking cessation, health professions education, behavior change, process outcomes, patient satisfaction, patient safety, quality of care, patient-centered care, patient information leaflets, patient information brochure
- MeSH terms
- Manuals as Topic, Outcome and Process Assessment, Health Care, Periodicals as Topic, Practice Patterns, Physicians', Professional Practice, Practice Guidelines as Topic, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review