General practitioners' use of magnetic resonance imaging: an open randomized trial comparing telephone and written requests and an open randomized controlled trial of different methods of local guideline dissemination
Abstract
Aim To determine the impact and cost-effectiveness of telephone versus written access to magnetic resonance imaging (MRI), and of different strategies for disseminating locally produced guidelines, upon requests by general practitioners (GPs) for knee and lumbar spine investigation. Material and methods Two sequential pragmatic open cluster-randomized trials were conducted within 39 general practices. The outcome measure in each trial was concordance of request with local guidelines. Trial 1: practices requested MRI by telephone or in writing. Trial 2: all practices received guidelines, plus either: a practice-based seminar, practice-specific audit feedback, both seminar and feedback, or neither. Results A total of 414 requests were assessed in the two trials. Trial 1: telephone access cost pound4.86 more per request but rates of concordant requests were equivalent (65%/64%: telephone/written). Trial 2: compared to the control group, costs per practice were pound1911 higher in seminar group, pound1543 higher in feedback group and pound3578 higher for those receiving both. Concordance was greater following the intervention (74% vs 65%; P < 0.05), but there was no difference between the four study groups. Conclusions Method of access did not affect concordance. Written access was more cost-effective. Seminars and feedback were no more effective in modifying practice than guidelines alone, which was thus the most cost-effective option.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Robling 2002 found minimal difference in compliance with guidelines for MRI of the lumbar spine or knee (unadjusted RD = 4%, high risk of bias; no P value reported).
“Robling 2002 found minimal difference in compliance with guidelines for MRI (Magnetic Resonance Imaging) of the lumbar spine or knee (unadjusted RD = 4%, high risk of bias; no P value reported).”
From Audit and feedback: effects on professional practice and healthcare outcomes (2012) · cites this paper as Robling 2002
Cites
Methods for the economic evaluation of health care programmes
Wilson, S. (1987) · Journal of Epidemiology & Community Health · doi:10.1136/jech.41.4.355-a · Cited by 4,312 · see citing works
Roethlisberger, F. J., & Dickson, W. J. (2003) · Cited by 2,826 · see citing works
Clinical guidelines: Using clinical guidelines
Feder, G. S., Eccles, M., Grol, R. P. T. M., Griffiths, C., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7185.728 · Cited by 393 · see citing works
Achieving health gain through clinical guidelines II: Ensuring guidelines change medical practice.
Grimshaw, J., & Russell, I. T. (1994) · BMJ Quality & Safety · doi:10.1136/qshc.3.1.45 · Cited by 328 · see citing works
Why general practitioners and consultants change their clinical practice: a critical incident study
Allery, L. A., Owen, P. A., & Robling, M. R. (1997) · BMJ · doi:10.1136/bmj.314.7084.870 · Cited by 188 · see citing works
Self-citationMaking the best use of a department of clinical radiology--guidelines for doctors.
Needham, G. (1996) · PubMed · Cited by 178 · see citing works
Eugene W. Caldwell Lecture. Clinical efficacy of diagnostic imaging: love it or leave it.
Thornbury, J. R. (1994) · American Journal of Roentgenology · doi:10.2214/ajr.162.1.8273645 · Cited by 165 · see citing works
Direct access MRI for general practitioners — Influence on patient management
Apthorp, L., Daly, C. A., Morrison, I. D., & Field, S. (1998) · Clinical Radiology · doi:10.1016/s0009-9260(98)80036-6 · Cited by 23 · see citing works
An exploration of GPs' use of MRI: a critical incident study
Robling, M. R. (1998) · Family Practice · doi:10.1093/fampra/15.3.236 · Cited by 22 · see citing works
Self-citationRoland, M. O., & Bewley, B. (1992) · Journal of Public Health · doi:10.1093/oxfordjournals.pubmed.a042747 · Cited by 20 · see citing works
Impact of general practitioners' referral letters to an emergency department.
Montalto, M., Harris, P., & Rosengarten, P. (1994) · PubMed · Cited by 18 · see citing works
Southgate, J., & Thomas, N. P. (1996) · BMJ · doi:10.1136/bmj.312.7034.849a · Cited by 17 · see citing works
Patients should be seen by an experienced orthopaedic surgeon
Mackenzie, R., Edwards, D., & Dixon, A. K. (1996) · BMJ · doi:10.1136/bmj.312.7034.849b · Cited by 15 · see citing works
Magnetic resonance imaging of the lumbar spine: direct access for general practitioners.
Chawda, S. J., Watura, R., & Lloyd, D. C. (1997) · PubMed · Cited by 14 · see citing works
Robling, M. R., Kinnersley, Houston, Hourihan, Cohen, & Hale (1999) · Medical Education · doi:10.1046/j.1365-2923.1999.00461.x · Cited by 9 · see citing works
Self-citationIMPLEMENTING CLINICAL GUIDELINES: A Practical Guide
Humphris, D., & Littlejohns, P. (1999) · Cited by 7 · see citing works
Ball, C., & Box, O. (1997) · PubMed · Cited by 6 · see citing works
Implementing clinical guidelines − a practical guide
HOFFBRAND, B. I. (2000) · Postgraduate Medical Journal · doi:10.1136/pmj.76.892.127c · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · see citing works
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912 · see citing works
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · BMJ Quality & Safety · doi:10.1136/qshc.2006.018549 · Cited by 364 · see citing works
Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306 · see citing works
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. G., Kristoffersen, D., O'Brien, M., & Oxman, A. D. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259 · Cited by 285 · see citing works
Yoong, S. L., Hall, A. E., Stacey, F. G., Grady, A., Sutherland, R., Wyse, R., Anderson, A., Nathan, N., & Wolfenden, L. (2020) · Implementation Science · doi:10.1186/s13012-020-01011-0 · Cited by 184 · see citing works
Tools developed and disseminated by guideline producers to promote the uptake of their guidelines
Flodgren, G., Hall, A. M., Goulding, L., Eccles, M., Grimshaw, J., Leng, G. C., & Shepperd, S. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010669.pub2 · Cited by 159 · see citing works
French, S. D., McKenzie, J. E., O’Connor, D. A., Grimshaw, J., Mortimer, D., Francis, J., Michie, S., Spike, N., Schattner, P. L., Kent, P. M., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065471 · Cited by 153 · see citing works
Doctors With a Special Interest in Back Pain Have Poorer Knowledge About How to Treat Back Pain
Buchbinder, R., Staples, M., & Jolley, D. (2009) · Spine · doi:10.1097/brs.0b013e318195d688 · Cited by 117 · see citing works
Interventions for improving the appropriate use of imaging in people with musculoskeletal conditions
French, S. D., Green, S., Buchbinder, R., & Barnes, H. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006094.pub2 · Cited by 90 · see citing works
Audit and feedback: effects on professional practice
Ivers, N. M., Yogasingam, S., Lacroix, M., Brown, K. A., Antony, J., Soobiah, C., Simeoni, M., Willis, T. A., Crawshaw, J., Antonopoulou, V., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub4 · Cited by 103 · see citing works
Using audit and feedback to health professionals to improve the quality and safety of health care
Flottorp, S. A., Jamtvedt, G., Gibis, B., & McKee, M. (2010) · Cited by 77 · see citing works
McKenzie, J. E., French, S. D., O'Connor, D. A., Grimshaw, J. M., Mortimer, D., Michie, S., Francis, J., Spike, N., Schattner, P., Kent, P. M., et al. (2008) · Implementation Science · doi:10.1186/1748-5908-3-11 · Cited by 77 · see citing works
Hoomans, T., Evers, S. M. A. A., Ament, A. J. H. A., Hübben, M. W. A., van der Weijden, T., Grimshaw, J. M., & Severens, J. L. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00175.x · Cited by 71 · see citing works
Blank, L., Baxter, S., Woods, H. B., Goyder, E., Lee, A., Payne, N., & Rimmer, M. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x682837 · Cited by 64 · see citing works
Professional interventions for general practitioners on the management of musculoskeletal conditions
Tzortziou Brown, V., Underwood, M., Mohamed, N., Westwood, O., & Morrissey, D. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007495.pub2 · Cited by 62 · see citing works
Hodder, R. K., Wolfenden, L., Kamper, S. J., Lee, H., Williams, A. J., O’Brien, K. M., & Williams, C. M. (2016) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2017.05.002 · Cited by 44 · see citing works
O’Connor, D. A., Glasziou, P., Maher, C. G., McCaffery, K. J., Schram, D., Maguire, B., Ma, R., Billot, L., Gorelik, A., Traeger, A. C., et al. (2022) · JAMA · doi:10.1001/jama.2022.14587 · Cited by 43 · see citing works
McKenzie, J. E., O'Connor, D. A., Page, M. J., Mortimer, D. S., French, S. D., Walker, B. F., Keating, J. L., Grimshaw, J. M., Michie, S., Francis, J. J., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-86 · Cited by 42 · see citing works
Espeland, A., Nl, N., Løge, I., Engebretsen, L., & Ellingsen, J. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-115 · Cited by 42 · see citing works
Blank, L., Baxter, S. K., Woods, H. B., Goyder, E., Lee, A. C., Payne, N., & Rimmer, M. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03240 · Cited by 37 · see citing works
Hofmann, B. (2010) · Medicine Health Care and Philosophy · doi:10.1007/s11019-010-9233-8 · Cited by 28 · see citing works
Hall, A. M., Richmond, H., Pike, A. E., Lawrence, R., Etchegary, H., Swab, M., Thompson, J., Albury, C., Hayden, J. A., Patey, A. M., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01136-w · Cited by 19 · see citing works
Gough-Palmer, A., Burnett, C., & Gedroyc, W. (2009) · British Journal of Radiology · doi:10.1259/bjr/88267089 · Cited by 12 · see citing works
Costs of Physician Continuous Professional Development: A Systematic Review
Cook, D. A., Wilkinson, J. M., & Foo, J. (2022) · Academic Medicine · doi:10.1097/acm.0000000000004805 · Cited by 10 · see citing works
Zhao, S., Langford, A. V., Chen, Q., Lyu, M., Yang, Z., French, S. D., Williams, C. M., & Lin, C. C. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102916 · Cited by 9 · see citing works
RetractedAudit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Cited by 7 · see citing works
Badejo, O. A., Saleeb, M., Hall, A. M., Furlong, B., Logan, G. S., Gao, Z., Barrett, B. J., Alcock, L. J., & Aubrey‐Bassler, K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300001 · Cited by 3 · see citing works
Shenoy, S. (2013) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 3 · see citing works
Zhao, S., Langford, A. V., Chen, Q., Lyu, M., Yang, Z., French, S. D., Williams, C. M., & Lin, C. C. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103639 · Cited by 1 · see citing works
Hickey, S., Saywell, N. L., Adams, T. M., & Hill, J. (2025) · Musculoskeletal Care · doi:10.1002/msc.70086 · Cited by 1 · see citing works
Silva, M. L. (2012) · Americanae (AECID Library)
Opportunities and strategies to drive appropriate use of MRI in Austria. Part 2
Kisser, A., & Naimer, C. (2015)
A Program to Reduce Imaging for Acute Low Back Pain
Weekes, L., & Weston, C. (2020) · Springer eBooks · doi:10.1007/978-981-15-2333-5_11
Espeland, A., Nl, N., Løge, I., Engebretsen, L., & Ellingsen, J. (2007) · Figshare · doi:10.6084/m9.figshare.15079984
Hall, A., Richmond, H., Pike, A., Lawrence, R., Etchegary, H., Swab, M., Thompson, J., Albury, C., Hayden, J., Patey, A. M., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14903730
Hall, A., Richmond, H., Pike, A., Lawrence, R., Etchegary, H., Swab, M., Thompson, J., Albury, C., Hayden, J., Patey, A. M., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14903733
Espeland, A., Nl, N., Løge, I., Engebretsen, L., & Ellingsen, J. (2007) · Figshare · doi:10.6084/m9.figshare.15079987
- Authors
- Robling, M. R., Houston, H. L. A., Kinnersley, P., Hourihan, M. D., Cohen, D. R., Hale, J., & Hood, K.
- Affiliations
- University Hospital of Wales (GB)
- University of Glamorgan (GB)
- Venue
- Clinical Radiology
- Publisher
- Elsevier BV
- Published
- 2002-05
- Volume
- 57
- Issue
- 5
- Pages
- 402-407
- ISSN
- 0009-9260 (ISSN-L)
- OpenAlex
- W2119383325
- Cited by
- 39
- References
- 18
- Citations by year
- 2025: 3 · 2024: 2 · 2022: 2 · 2021: 3 · 2020: 2 · 2016: 3 · 2015: 2 · 2014: 1 · 2013: 2 · 2012: 2
- FWCI
- 0.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Radiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Keywords
- magnetic resonance imaging, general practitioners, guideline adherence, guideline dissemination, telephone access, knee imaging, lumbar spine imaging, audit and feedback, cost-effectiveness, primary care
- MeSH terms
- Cost-Benefit Analysis, Education, Medical, Continuing, Humans, Information Services, Knee, Lumbar Vertebrae, Magnetic Resonance Imaging, Physicians, Family, Referral and Consultation, Regression Analysis, Telephone, Chi-Square Distribution, Practice Guidelines as Topic, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review