The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial
Open accessAbstract
Background Radiological tests are often used by general practitioners (GPs). These tests can be overused and contribute little to clinical management. We aimed to assess two methods of reducing GP requests for radiological tests in accordance with the UK Royal College of Radiologists' guidelines on lumbar spine and knee radiographs. Methods We assessed audit and feedback, and educational reminder messages in six radiology departments and 244 general practices that they served. The study was a before-and-after, pragmatic, cluster randomised controlled trial with a 232 factorial design. A random subset of GP patients' records were examined for concordance with the guidelines. The main outcome measure was number of radiograph requests per 1000 patients per year. Analysis was by intention to treat. Findings The effect of educational reminder messages (ie, the change in request rate after intervention) was an absolute change of -1.53 (95% CI -2.5 to -0.57) for lumbar spine and of -1.61 (-2.6 to -0.62) for knee radiographs, both relative reductions of about 20%. The effect of audit and feedback was an absolute change of -0.07 (-1.3 to 0.9) for lumbar spine of 0.04 (-0.95 to 1.03) for knee radiograph requests, both relative reductions of about 1%. Concordance between groups did not differ significantly. Interpretation 6-monthly feedback of audit data is ineffective but the routine attachment of educational reminder messages to radiographs is effective and does not affect quality of referrals. Any department of radiology that handles referrals from primary care could deliver this intervention to good effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a 2x2 factorial trial, Eccles 2001 found that adding reminders to audit and feedback reduced x‐ray utilisation (adjusted change relative to baseline control = 46%; no P value reported).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Eccles 2001
Citations
Cites
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,791
Self-citationEffectiveness and Efficiency: Random Reflections on Health Services
L'Etang, H. (1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,905
Oxman, A. D., Thomson, M., Davis, D. A., & Haynes, R. B. (1995) · PubMed Central · Cited by 1,847
Fundamentals of Biostatistics.
Cornell, R. G., & ROSNER, B. A. (1987) · Journal of the American Statistical Association · doi:10.2307/2289416 · Cited by 1,613
Fundamentals of Biostatistics.
Barath, E., & ROSNER, B. A. (1992) · Biometrics · doi:10.2307/2532371 · Cited by 1,184
Protocol-Based Computer Reminders, the Quality of Care and the Non-Perfectability of Man
McDonald, C. J. (1976) · New England Journal of Medicine · doi:10.1056/nejm197612092952405 · Cited by 797
RECURRENT DISLOCATION OF THE SHOULDER
British Medical Journal Publishing Group (1929) · BMJ · doi:10.1136/bmj.2.3589.732 · Cited by 441
Experimental and quasi-experimental designs for evaluating guideline implementation strategies
Grimshaw, J. (2000) · Family Practice · doi:10.1093/fampra/17.suppl_1.s11 · Cited by 382
Self-citationTierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Research works printed but not linked: 1
- 1994, Implementing clinical practice guidelines: can guidelines be used to improve clinical practice?, Effect Health Care, 8, 1
Cited by
Sorted by citations
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationPrevention and treatment of low back pain: evidence, challenges, and promising directions
Foster, N. E., Anema, J. R., Cherkin, D., Chou, R., Cohen, S. P., Gross, D. P., Ferreira, P. H., Fritz, J. M., Koes, B. W., Peul, W., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30489-6 · Cited by 2,398
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912
Printed educational materials: effects on professional practice and healthcare outcomes
Giguere, A. M. C., Légaré, F., Grimshaw, J., Turcotte, S., Fiander, M., Grudniewicz, A., Makosso‐Kallyth, S., Wolf, F. M., Farmer, A. P., & Gagnon, M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004398.pub3 · Cited by 904
Self-citationResearch designs for studies evaluating the effectiveness of change and improvement strategies
Eccles, M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.47 · Cited by 586
Self-citation
Metadata
- Authors
- Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., & Bond, S.
- Affiliations
- Newcastle University (GB)
- University of Aberdeen (GB)
- Newcastle upon Tyne Hospital (GB)
- Aberdeen Royal Infirmary (GB)
- Corresponding author
- Eccles, Martin
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2001-05
- Volume
- 357
- Issue
- 9266
- Pages
- 1406-1409
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2123697166
- Cited by
- 222
- References
- 31
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 6 · 2023: 10 · 2022: 10 · 2021: 7 · 2020: 18 · 2019: 8 · 2018: 13 · 2017: 3 · 2016: 12 · 2015: 11 · 2014: 7 · 2013: 11 · 2012: 6
- FWCI
- 23.80
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- CLOK (University of Central Lancashire) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Royal College of Radiologists
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- audit and feedback, lumbar spine radiographs, knee radiographs, guideline adherence, general practitioners, radiology department
- MeSH terms
- Adult, England, Family Practice, Feedback, Humans, Knee, Lumbar Vertebrae, Radiography, Referral and Consultation, Scotland, Cluster Analysis, Reminder Systems, Practice Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review