The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial
Open accessAbstract
Background Radiological tests are often used by general practitioners (GPs). These tests can be overused and contribute little to clinical management. We aimed to assess two methods of reducing GP requests for radiological tests in accordance with the UK Royal College of Radiologists' guidelines on lumbar spine and knee radiographs. Methods We assessed audit and feedback, and educational reminder messages in six radiology departments and 244 general practices that they served. The study was a before-and-after, pragmatic, cluster randomised controlled trial with a 232 factorial design. A random subset of GP patients' records were examined for concordance with the guidelines. The main outcome measure was number of radiograph requests per 1000 patients per year. Analysis was by intention to treat. Findings The effect of educational reminder messages (ie, the change in request rate after intervention) was an absolute change of -1.53 (95% CI -2.5 to -0.57) for lumbar spine and of -1.61 (-2.6 to -0.62) for knee radiographs, both relative reductions of about 20%. The effect of audit and feedback was an absolute change of -0.07 (-1.3 to 0.9) for lumbar spine of 0.04 (-0.95 to 1.03) for knee radiograph requests, both relative reductions of about 1%. Concordance between groups did not differ significantly. Interpretation 6-monthly feedback of audit data is ineffective but the routine attachment of educational reminder messages to radiographs is effective and does not affect quality of referrals. Any department of radiology that handles referrals from primary care could deliver this intervention to good effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a 2x2 factorial trial, Eccles 2001 found that adding reminders to audit and feedback reduced x‐ray utilisation (adjusted change relative to baseline control = 46%; no P value reported).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Eccles 2001
Citations
Cites
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,791
Self-citationEffectiveness and Efficiency: Random Reflections on Health Services
L'Etang, H. (1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,905
Oxman, A. D., Thomson, M., Davis, D. A., & Haynes, R. B. (1995) · PubMed Central · Cited by 1,847
Fundamentals of Biostatistics.
Cornell, R. G., & ROSNER, B. A. (1987) · Journal of the American Statistical Association · doi:10.2307/2289416 · Cited by 1,613
Fundamentals of Biostatistics.
Barath, E., & ROSNER, B. A. (1992) · Biometrics · doi:10.2307/2532371 · Cited by 1,184
Protocol-Based Computer Reminders, the Quality of Care and the Non-Perfectability of Man
McDonald, C. J. (1976) · New England Journal of Medicine · doi:10.1056/nejm197612092952405 · Cited by 797
RECURRENT DISLOCATION OF THE SHOULDER
British Medical Journal Publishing Group (1929) · BMJ · doi:10.1136/bmj.2.3589.732 · Cited by 441
Experimental and quasi-experimental designs for evaluating guideline implementation strategies
Grimshaw, J. (2000) · Family Practice · doi:10.1093/fampra/17.suppl_1.s11 · Cited by 382
Self-citationTierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Research works printed but not linked: 1
- 1994, Implementing clinical practice guidelines: can guidelines be used to improve clinical practice?, Effect Health Care, 8, 1
Cited by
Sorted by citations
Items 201–222 of 222
Mudança de comportamento de médicos com transferência passiva de informações
de Azevedo, J., Fisher, P. D., & Bordin, R. (2010) · Revista Brasileira de Educação Médica · doi:10.1590/s0100-55022010000400013
Healthcare quality improvement programme improves monitoring of people with diabetes
Denig, P. (2004) · Evidence-based Healthcare · doi:10.1016/j.ehbc.2004.03.005
Lineker, S. C. (2009) · UWSpace (University of Waterloo)
Eccles, M., Grimshaw, J., Campbell, M., & Ramsay, C. R. (2003)
Self-citationTrietsch, J. (2016) · Research Publications (Maastricht University) · doi:10.26481/dis.20161021jt
Pallás, J. M. A. A., & Villa, J. J. (2004) · Elsevier eBooks · doi:10.1016/b978-84-8174-709-6.50006-3
A Program to Reduce Imaging for Acute Low Back Pain
Weekes, L., & Weston, C. (2020) · Springer eBooks · doi:10.1007/978-981-15-2333-5_11
Maximizing research value: adequate reporting and effective (de-)implementation strategies
Heus, P. (2020) · Utrecht University Repository (Utrecht University) · doi:10.33540/8
GP request rejections: an analysis for ultrasound service improvement at one centre
Taylor, M. A. (2020) · BMJ Open Quality · doi:10.1136/bmjoq-2020-001108
Geary, L. (2020) · Figshare
1차 의료기관에서 시행되는 의사소통 교육이 가져오는 긍정적 결과에 대한 체계적 검토
엄새린, & 이귀한 (2010) · Health Communication the Official Journal of Korean Academy on Communication in Healthcare
Imaging for Knee and Shoulder Problems
Hollingworth, W., Dixon, A. K., & Jenner, J. (2006) · Springer eBooks · doi:10.1007/0-387-31216-1_15
Kumar, S., & Tian, E. J. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.735730878.793561724
Evaluating De‐Implementation Interventions
Goulão, B., Verkerk, E. W., Thavorn, K., Presseau, J., & Taljaard, M. (2023) · doi:10.1002/9781119862758.ch10
Effectiveness of Implementation Interventions in Musculoskeletal Healthcare: A Systematic ReviewPreprint
Hansen, P. B., Bahnsen, M., Nørgaard, M. S., Jepsen, J. F., Rathleff, M. S., & Lyng, K. D. (2023) · medRxiv · doi:10.1101/2023.11.29.23299209 · Cited by 1
Gransjøen, A. M., Wiig, S., Lysdahl, K. B., & Hofmann, B. (2020) · Figshare · doi:10.6084/m9.figshare.12285320
Il faut enseigner la pertinence des actes de radiologie aux étudiants en médecine
Nonent, M., Chodorowski, M., Inizan-Quéru, N., & Reber, G. (2026) · Journal d imagerie diagnostique et interventionnelle · doi:10.1016/j.jidi.2026.04.003
Content matters - sending emails to ensure appropriate use of laboratory fees
Godager, G., Kaarbøe, O. M., Moger, T. A., & Aars, O. K. (2026) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2026.102599
Cluster-Randomized Trials — Insights from Cardiovascular Prevention
Vazirani, R., Ibáñez, B., Bhatt, D. L., & Fuster, V. (2026) · NEJM Evidence · doi:10.1056/evidctw2600148
18 Imaging for Knee and Shoulder Problems
Hollingworth, W., Dixon, A. K., & Jenner, J. (2011) · Springer eBooks · doi:10.1007/978-1-4419-7777-9_18
Metadata
- Authors
- Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., & Bond, S.
- Affiliations
- Newcastle University (GB)
- University of Aberdeen (GB)
- Newcastle upon Tyne Hospital (GB)
- Aberdeen Royal Infirmary (GB)
- Corresponding author
- Eccles, Martin
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2001-05
- Volume
- 357
- Issue
- 9266
- Pages
- 1406-1409
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2123697166
- Cited by
- 222
- References
- 31
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 6 · 2023: 10 · 2022: 10 · 2021: 7 · 2020: 18 · 2019: 8 · 2018: 13 · 2017: 3 · 2016: 12 · 2015: 11 · 2014: 7 · 2013: 11 · 2012: 6
- FWCI
- 23.80
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- CLOK (University of Central Lancashire) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Royal College of Radiologists
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- audit and feedback, lumbar spine radiographs, knee radiographs, guideline adherence, general practitioners, radiology department
- MeSH terms
- Adult, England, Family Practice, Feedback, Humans, Knee, Lumbar Vertebrae, Radiography, Referral and Consultation, Scotland, Cluster Analysis, Reminder Systems, Practice Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review