The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial
Open accessAbstract
Background Radiological tests are often used by general practitioners (GPs). These tests can be overused and contribute little to clinical management. We aimed to assess two methods of reducing GP requests for radiological tests in accordance with the UK Royal College of Radiologists' guidelines on lumbar spine and knee radiographs. Methods We assessed audit and feedback, and educational reminder messages in six radiology departments and 244 general practices that they served. The study was a before-and-after, pragmatic, cluster randomised controlled trial with a 232 factorial design. A random subset of GP patients' records were examined for concordance with the guidelines. The main outcome measure was number of radiograph requests per 1000 patients per year. Analysis was by intention to treat. Findings The effect of educational reminder messages (ie, the change in request rate after intervention) was an absolute change of -1.53 (95% CI -2.5 to -0.57) for lumbar spine and of -1.61 (-2.6 to -0.62) for knee radiographs, both relative reductions of about 20%. The effect of audit and feedback was an absolute change of -0.07 (-1.3 to 0.9) for lumbar spine of 0.04 (-0.95 to 1.03) for knee radiograph requests, both relative reductions of about 1%. Concordance between groups did not differ significantly. Interpretation 6-monthly feedback of audit data is ineffective but the routine attachment of educational reminder messages to radiographs is effective and does not affect quality of referrals. Any department of radiology that handles referrals from primary care could deliver this intervention to good effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a 2x2 factorial trial, Eccles 2001 found that adding reminders to audit and feedback reduced x‐ray utilisation (adjusted change relative to baseline control = 46%; no P value reported).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Eccles 2001
Citations
Cites
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,791
Self-citationEffectiveness and Efficiency: Random Reflections on Health Services
L'Etang, H. (1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,905
Oxman, A. D., Thomson, M., Davis, D. A., & Haynes, R. B. (1995) · PubMed Central · Cited by 1,847
Fundamentals of Biostatistics.
Cornell, R. G., & ROSNER, B. A. (1987) · Journal of the American Statistical Association · doi:10.2307/2289416 · Cited by 1,613
Fundamentals of Biostatistics.
Barath, E., & ROSNER, B. A. (1992) · Biometrics · doi:10.2307/2532371 · Cited by 1,184
Protocol-Based Computer Reminders, the Quality of Care and the Non-Perfectability of Man
McDonald, C. J. (1976) · New England Journal of Medicine · doi:10.1056/nejm197612092952405 · Cited by 797
RECURRENT DISLOCATION OF THE SHOULDER
British Medical Journal Publishing Group (1929) · BMJ · doi:10.1136/bmj.2.3589.732 · Cited by 441
Experimental and quasi-experimental designs for evaluating guideline implementation strategies
Grimshaw, J. (2000) · Family Practice · doi:10.1093/fampra/17.suppl_1.s11 · Cited by 382
Self-citationTierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Achieving health gain through clinical guidelines II: Ensuring guidelines change medical practice.
Grimshaw, J., & Russell, I. T. (1994) · BMJ Quality & Safety · doi:10.1136/qshc.3.1.45 · Cited by 328
Self-citationAnalysis of cluster randomized trials in primary care: a practical approach
Campbell, M. K., Mollison, J., Steen, N., Grimshaw, J. M., & Eccles, M. (2000) · Family Practice · doi:10.1093/fampra/17.2.192 · Cited by 327
Self-citationImplementing guidelines in general practice care.
Grol, R. P. T. M. (1992) · BMJ Quality & Safety · doi:10.1136/qshc.1.3.184 · Cited by 291
(1996) Low Back Pain Evidence Review London: Royal College of General Practitioners
Waddell, G., Feder, G. S., McIntosh, A., Lewis, M., & Hutchinson, A. (1998) · Journal of Manual & Manipulative Therapy · doi:10.1179/jmt.1998.6.3.151 · Cited by 187
Making the best use of a department of clinical radiology--guidelines for doctors.
Needham, G. (1996) · PubMed · Cited by 178
Self-citationOakeshott, P., Kerry, S., & Williams, J. E. F. (1994) · PubMed · Cited by 102
Do clinical guidelines improve general practice management and referral of infertile couples?
Emslie, C., Grimshaw, J., & Templeton, A. (1993) · BMJ · doi:10.1136/bmj.306.6894.1728 · Cited by 90
Self-citationMULTICENTRE TRIAL OF FOUR STRATEGIES TO REDUCE USE OF A RADIOLOGICAL TEST
Fowkes, F. G. R., Evans, K. T., Hartley, G., Nolan, D. J., Roberts, C. J., Davies, E. R., Green, G., Hugh, A. E., Power, A., & Roylance, J. (1986) · The Lancet · doi:10.1016/s0140-6736(86)92327-5 · Cited by 78
Kerry, S., Oakeshott, P., Dundas, D., & Williams, J. E. F. (2000) · Family Practice · doi:10.1093/fampra/17.1.46 · Cited by 77
Disseminating research, changing practice
Dunn, E. V. (1994) · Medical Entomology and Zoology · Cited by 63
Chronic low back pain in primary care: a prospective study on the management and course
van Tulder, M. W., Koes, B. W., Metsemakers, J. F. M., & Bouter, L. M. (1998) · Family Practice · doi:10.1093/fampra/15.2.126 · Cited by 59
IMPLEMENTATION OF GUIDELINES FOR THE USE OF SKULL RADIOGRAPHS IN PATIENTS WITH HEAD INTURIES
Fowkes, F. G. R., Williams, L. A., Cooke, B., Evans, R., Gehlbach, S. H., & Roberts, C. J. (1984) · The Lancet · doi:10.1016/s0140-6736(84)90715-3 · Cited by 46
An audit of knee radiographs performed for general practitioners.
Morgan, B., Mullick, S. P., Harper, W. M., & Finlay, D. B. (1997) · British Journal of Radiology · doi:10.1259/bjr.70.831.9166050 · Cited by 45
The effect of radiology guidelines for general practitioners in plymouth
Meiring, P. D. V., & Wells, I. P. (1990) · Clinical Radiology · doi:10.1016/s0009-9260(05)82146-4 · Cited by 30
Chest radiography guidelines for general practitioners: A practical approach
Bearcroft, P. W. P., Small, J., & Flower, C. D. R. (1994) · Clinical Radiology · doi:10.1016/s0009-9260(05)82916-2 · Cited by 28
Butt, W. P. (1989) · Clinical Radiology · doi:10.1016/s0009-9260(89)80004-2 · Cited by 21
Plain Radiography of the Lumbosacral Spine
Espeland, A., Albrektsen, G., & Larsen, J. L. (1999) · Acta Radiologica · doi:10.1080/02841859909174403 · Cited by 21
Does a reduction in general practitioners' use of diagnostic tests lead to more hospital referrals?
Winkens, R. A. G., Grol, R. P. T. M., Beusmans, G. H. M. I., Kester, A. D. M., Knottnerus, J. A., & Pop, P. (1995) · Europe PMC (PubMed Central) · Cited by 18
Research works printed but not linked: 1
- 1994, Implementing clinical practice guidelines: can guidelines be used to improve clinical practice?, Effect Health Care, 8, 1
Cited by
Sorted by citations
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationPrevention and treatment of low back pain: evidence, challenges, and promising directions
Foster, N. E., Anema, J. R., Cherkin, D., Chou, R., Cohen, S. P., Gross, D. P., Ferreira, P. H., Fritz, J. M., Koes, B. W., Peul, W., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30489-6 · Cited by 2,398
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Printed educational materials: effects on professional practice and healthcare outcomes
Giguere, A. M. C., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso‐Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 904
Self-citationResearch designs for studies evaluating the effectiveness of change and improvement strategies
Eccles, M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.47 · Cited by 586
Self-citation
Metadata
- Authors
- Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., & Bond, S.
- Affiliations
- Newcastle University (GB)
- University of Aberdeen (GB)
- Newcastle upon Tyne Hospital (GB)
- Aberdeen Royal Infirmary (GB)
- Corresponding author
- Eccles, Martin
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2001-05
- Volume
- 357
- Issue
- 9266
- Pages
- 1406-1409
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2123697166
- Cited by
- 222
- References
- 31
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 6 · 2023: 10 · 2022: 10 · 2021: 7 · 2020: 18 · 2019: 8 · 2018: 13 · 2017: 3 · 2016: 12 · 2015: 11 · 2014: 7 · 2013: 11 · 2012: 6
- FWCI
- 23.80
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- CLOK (University of Central Lancashire) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Royal College of Radiologists
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- audit and feedback, lumbar spine radiographs, knee radiographs, guideline adherence, general practitioners, radiology department
- MeSH terms
- Adult, England, Family Practice, Feedback, Humans, Knee, Lumbar Vertebrae, Radiography, Referral and Consultation, Scotland, Cluster Analysis, Reminder Systems, Practice Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review