The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial
Open accessAbstract
OBJECTIVE: To evaluate the use of a computerised support system for decision making for implementing evidence based clinical guidelines for the management of asthma and angina in adults in primary care. DESIGN: A before and after pragmatic cluster randomised controlled trial utilising a two by two incomplete block design. SETTING: 60 general practices in north east England. PARTICIPANTS: General practitioners and practice nurses in the study practices and their patients aged 18 or over with angina or asthma. MAIN OUTCOME MEASURES: Adherence to the guidelines, based on review of case notes and patient reported generic and condition specific outcome measures. RESULTS: The computerised decision support system had no significant effect on consultation rates, process of care measures (including prescribing), or any patient reported outcomes for either condition. Levels of use of the software were low. CONCLUSIONS: No effect was found of computerised evidence based guidelines on the management of asthma or angina in adults in primary care. This was probably due to low levels of use of the software, despite the system being optimised as far as was technically possible. Even if the technical problems of producing a system that fully supports the management of chronic disease were solved, there remains the challenge of integrating the systems into clinical encounters where busy practitioners manage patients with complex, multiple conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Importantly there is clear evidence that CDSS tools are not always used when available, 15 with up to 96% of alerts being overridden or ignored by physicians.[16][17][18][19]”
From Computerized clinical decision support for prescribing: provision does not guarantee uptake (2010) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · PubMed · Cited by 33,716
EuroQol: the current state of play
Brooks, R. (1996) · Health Policy · doi:10.1016/0168-8510(96)00822-6 · Cited by 5,815
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Hunt, D. L., Haynes, R. B., Hanna, S., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,684
Spertus, J., Winder, J. A., Dewhurst, T. A., Deyo, R., Prodzinski, J., McDonnell, M., & Fihn, S. (1995) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(94)00397-9 · Cited by 1,413
Measuring Quality of Life in Asthma
Juniper, E. F., Guyatt, G. H., Ferrie, P. J., & Griffith, L. E. (1993) · American Review of Respiratory Disease · doi:10.1164/ajrccm/147.4.832 · Cited by 887
Validation of a Standardized Version of the Asthma Quality of Life Questionnaire
Juniper, E. F., Buist, A. S., Cox, F. M., Ferrie, P. J., & King, D. (1999) · CHEST Journal · doi:10.1378/chest.115.5.1265 · Cited by 713
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S. A., Russell, I. T., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · BMJ Quality & Safety · doi:10.1136/qshc.4.1.55 · Cited by 467
Evaluation Methods in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (1997) · Computers and medicine · doi:10.1007/978-1-4757-2685-5 · Cited by 450
Sample Size Calculations for Cluster Randomised Trials
Campbell, M., Grimshaw, J., Steen, N., & Changing Professional Practice in Europe Group (EU BIOMED II Concerted Action) (2000) · Journal of Health Services Research & Policy · doi:10.1177/135581960000500105 · Cited by 298
Research works printed but not linked: 2
- *Effect sizes; estimates of ratio of mean number of consultations for participants in practices that received computerised decision support system to mean number of consultations for participants in control practices based on Poisson regression model. †Patients who consulted after intervention and had not had variable recorded anywhere in their clinical record during period before intervention. Primary care page 4 of 7 BMJ VOLUME 325 26 OCTOBER 2002 bmj.com on 17 July 2023 by guest. Protected by copyright. http://www.bmj.com/ BMJ: first published as 10.1136/bmj.325.7370.941 on 26 October 2002. Downloaded from All patients 516 (43); 511 (43) 492 (42); 517 (45) 0.94 (0.67 to 1.33) Patients who consulted 515 (45); 510 (45) 491 (45); 516 (47) 0.94 (0.66 to 1.34) Compliance checked: All patients 426 (36); 442 (37) 446 (38); 471 (41) 0.82 (0.58 to 1.15) Patients who consulted 425 (37); 441 (39) 445 (40); 470 (43) 0.82 (0.58 to 1.16) Inhaler technique assessed: All patients 203 (17); 224 (19) 234 (20); 262 (23) 0.8 (0.5 to 1.28) Patients who consulted 203 (18); 224 (20) 233 (21); 262 (24) 0.81 (0.5 to 1.28) Asthma education, action plan, or both: All patients 79 (7); 60 (5) 108 (9); 78 (7) 0.84 (0.4 to 1.74) Patients who consulted 79 (7); 60 (5) 108 (10); 78 (7) 0.81 (0.39 to 1.67) Smoking status known: All patients 285 (24); 370 (32) 305 (26); 367 (32) 0.97 (0.65 to 1.45) Patients who consulted 285 (25); 369 (33) 303 (28); 367 (33) 0.98 (0.66 to 1.46) Smoking cessation advice or nicotine replacement therapy: All patients 57 (5); 81 (7) 68 (6); 103 (9) 0.75 (0.45 to 1.26) Patients who consulted 57 (5); 81 (8) 68 (6); 103 (9) 0.76 (0.46 to 1.27)
- *Guideline specifically recommended not using these combinations. Table 5 Drugs prescribed for patients with asthma before and after introduction of computerised decision support system. Values are numbers (percentages) unless stated otherwise Computerised system (n=1391) Controls (n=1385) Odds ratio (95% CI) Short acting 2 agonists 1138 (82); 1112 (80) 1160 (84); 1108 (80) 1.04 (0.83 to 1.31) Inhaled corticosteroids 1065 (77); 1001 (72) 1004 (73); 975 (70) 0.95 (0.78 to 1.16) Long acting 2 agonists 181 (13); 198 (14) 164 (12); 183 (13) 0.84 (0.59 to 1.20) Oral steroids 317 (23); 316 (23) 286 (21); 297 (21) 1.0 (0.82 to 1.22) Oral bronchodilators 100 (7); 95 (7) 120 (9); 119 (9) 1.38 (0.56 to 3.39) Primary care page 5 of 7 BMJ VOLUME 325 26 OCTOBER 2002 bmj.com on 17 July 2023 by guest. Protected by copyright. http://www.bmj.com/ BMJ: first published as 10.1136/bmj.325.7370.941 on 26 October 2002. Downloaded from
Cited by
Sorted by citations
Items 301–353 of 353
Kuo, J., Woodall, S., Harding, J. E., Crowther, C. A., & Alsweiler, J. M. (2022) · BMC Medical Ethics · doi:10.1186/s12910-022-00794-9 · Cited by 1
“This approach to gain ethical approval is similar to a previous cluster-randomised implementation trial conducted in the United Kingdom [33].”
ResultImpact of implementation strategies: controlled studies
van der Weijden, T., Eccles, M., Grimshaw, J., Campbell, M., Ramsay, C. R., & Grol, R. P. T. M. (2013) · doi:10.1002/9781118525975.ch20 · Cited by 1
The effects of IT on information culture in general medical practice
Williams, P. A. H. (2007) · Australasian Journal of Paramedicine · Cited by 1
Confusion over Cholesterol Testing
Goodman, K. W. (2004) · The AMA Journal of Ethic · doi:10.1001/virtualmentor.2004.6.12.ccas2-0412 · Cited by 1
Lipman, T. (2003) · BMJ · doi:10.1136/bmj.326.7398.1087-b · Cited by 1
“EDITOR—Eccles et al have shown not only the lack of effectiveness of a computerised decision support system based on evidence based guidelines but also some of the reasons why general practitioners found it unusable in everyday clinical practice.”
BackgroundInterfacing Computers and the Internet With Your Allergy Practice
Bernstein, J. A. (2004) · Clinical Reviews in Allergy & Immunology · doi:10.1385/criai:27:2:115 · Cited by 1
Tordera, M. P. (2005) · Medicina Clínica · doi:10.1157/13071761 · Cited by 1
Data interchange standards in healthcare: semantic interoperability in preoperative assessment
Ahmadian, L. (2011) · UvA-DARE (University of Amsterdam) · Cited by 1
Implementation of Electronic Medical Records and Preventive Services: A Mixed Methods Study
Greiver, M. (2011) · TSpace (University of Toronto) · Cited by 1
Monaco, C. F. (2016) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.5.2017.tde-01032017-134346 · Cited by 1
“Eccles 2002(51) diretrizes desenvolvidas localmente e descritas como baseadas em evidências Safran 1995(42) diretrizes desenvolvidas localmente por consenso”
A review of Primary Care Informatics: past progress, present reality, future prospects
Teasdale, S. (2005) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638445 · Cited by 1
“…most likely to render success [62,63,64] but few have shown major improvement; issues include relevance and accuracy of reminder or alert messages [65], lack of flexibility with patients with comorbidity [66], workflow integration [67], terminology and architecture [68], and interface design [69].”
Experimental Designs for Evaluation of Implementation Strategies
Wensing, M., & Grimshaw, J. (2020) · doi:10.1002/9781119488620.ch20 · Cited by 1
Machine learning & semantic web technologies for cancer care
Geetha, M. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20200409gm · Cited by 1
Information economics and the Internet
Coiera, E. (2003) · CRC Press eBooks · doi:10.1201/b13618-40 · Cited by 1
NHS information systems strategy, planning and implementation of primary service provision
Guah, M. W. (2004) · Elsevier eBooks · doi:10.1016/b978-075066140-9/50015-1
Rafiei, M. (2013) · University of Minnesota Digital Conservancy (University of Minnesota)
Impact of Guidelines on Healthcare from the Patient and Payor Perspective
McCarberg, B. H. (2004) · Disease Management & Health Outcomes · doi:10.2165/00115677-200412020-00001
Guah, M. W. (2026) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33492553
Evidence based practice, een onoverbrugbare kloof?
Coppoolse, R., & van Bemmel, R. (2004) · Stimulus · doi:10.1007/bf03076104
Persson, M. (2003) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Lineker, S. C. (2009) · UWSpace (University of Waterloo)
Young, R. (2003) · Europe PMC (PubMed Central)
20 Effecten van implementatie: gecontroleerde evaluaties
van der Weijden, T., Eccles, M., Grimshaw, J., & Grol, R. P. T. M. (2015) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-1077-7_20
Developing an Automatic Diagnostic System Driven by Consumer-Generated Health Care Data
(2010) · The Internet Journal of Medical Informatics · doi:10.5580/ceb
“2 of 8 implementation failure have been described, some resulting in substantial waste of time and resources [15-17].”
BackgroundTrietsch, J. (2016) · Research Publications (Maastricht University) · doi:10.26481/dis.20161021jt
Jibb, L. (2016) · TSpace (University of Toronto)
Telemetry and telecare in patients with respiratory diseases
Κουλούρη, Α. Γ., Ρούπα, Ζ., & Gourgoulianis, K. I. (2012) · University of Thessaly Institutional Repository (University of Thessaly)
Knowledge engineering complex decision support system in managing rheumatoid arthritis.
Pan, N. (2010) · Adelaide Research & Scholarship (AR&S) (University of Adelaide)
A laboratory demand optimisation project in primary carePreprint
Bucholc, M., O’Kane, M., O’Hare, B., Mullan, C., Cavanagh, P. G., Ashe, S., & Wong‐Lin, K. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/247163
“Variability for HbA1c increased from 23.8% to 36.6% (p = 0.00001).”
BackgroundInfluentialEvaluating and Improving Physician Prescribing
Lu, C. Y., Majumdar, T. L. S. R., Lipton, H. L., & Soumerai, S. B. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch19
Berman, J. J. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-404576-7.00012-5
Health and Clinical Management
Monga, B. (2004) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638194
“[1] conducted a pragmatic cluster randomized controlled trial of a computerized decision support system to implement clinical guidelines for the management of asthma and angina in adults in primary care.”
BackgroundMethod(2013) · Elsevier eBooks · doi:10.1016/b978-0-12-404576-7.09978-0
Effecten van implementatie: gecontroleerde evaluaties
van der Weijden, T., Eccles, M., Grimshaw, J., & Grol, R. P. T. M. (2017) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-1732-5_20
Berman, J. J. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-815609-4.00020-0
(2006) · Springer eBooks · doi:10.1007/0-387-30677-3_3
OTHER ARTICLES NOTED (25 Oct 02 to 17 Jan 03)
(2003) · Evidence-Based Nursing · doi:10.1136/ebn.6.2.e1
Kermc, I. (2022) · Acta Clinica Croatica · doi:10.20471/acc.2022.61.02.07
Clinical Decision Support Systems in Adults with Chronic Respiratory Disease: A Systematic Review
O’Neill, K., Parrott, H., Neely, C., McLeese, R. H., Fleming, G. F., Scott, M. J., & Bradley, J. M. (2024) · Current Respiratory Medicine Reviews · doi:10.2174/011573398x281958240531065955
Chakrabarti, B., Sankaranarayanan, R., Hartshorne‐Evans, N., Mclean, L., Pritchard, C., Jones, J., Salla, M., Dowie, L., Cooper, C. B., McKnight, E., et al. (2025) · ERJ Open Research · doi:10.1183/23120541.00669-2025
“Critics have previously cited low use as a barrier to implementation of such technology [11].”
SHARE-C: Social Healthcare Assistive Robot within a Lebanese Engagement Context
Dubayssi, N. A., Ismail, M., Ebrekgi, M., Daoud, Y. G., Bazarbachi, A. A., & Daher, N. A. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3748519
“A study by Eccles et al. [65] attributed the lack of noticeable effect of a novel computerized decision support system for asthma and angina management to “low levels of use of the software, despite the system being optimized as far as was technically possible.”
van Wyk, J. T., & van Wijk, M. A. M. (2004) · PubMed
Barretto, S. A., & Warren, J. (2005) · Springer eBooks · doi:10.1007/978-1-4020-7829-3_37
“... spectrum ofhealthcare activities [1 9]. Moreover, there is a widely held optimism (at least in the medical informatics community) that the use of clinical decision support systems- i.e., systems that provide patient-specific advice-can facilitate the practice ofevidence-based medicine and therebysubstantially impr…”
BackgroundTibble, H., Lee, B., & Skene, I. (2026) · npj Primary Care Respiratory Medicine · doi:10.1038/s41533-026-00498-2 · Cited by 1
What influences prescribing in General Practice? : an ethnographic exploration
Grant, A. M. (2010) · OpenGrey (Institut de l'Information Scientifique et Technique)
Keating, G. (2005) · Otago University Research Archive (University of Otago)
(2010) · PubMed Central · Cited by 40
Metadata
- Authors
- Eccles, M.
- Affiliations
- Newcastle University (GB)
- Corresponding author
- Eccles, M.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2002-10-26
- Volume
- 325
- Issue
- 7370
- Pages
- 941-941
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC130060
- OpenAlex
- W1996469473
- Cited by
- 354
- References
- 24
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 4 · 2023: 3 · 2022: 9 · 2021: 7 · 2020: 7 · 2019: 5 · 2018: 9 · 2017: 7 · 2016: 12 · 2015: 10 · 2014: 14 · 2013: 19 · 2012: 14
- FWCI
- 29.39
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- computerised decision support, clinical guidelines, asthma management, angina management, guideline adherence, primary care, general practitioners, practice nurses, drug prescribing, patient-reported outcomes, chronic disease management
- MeSH terms
- Angina Pectoris, Asthma, Decision Making, Computer-Assisted, Family Practice, Humans, Treatment Outcome, Practice Guidelines as Topic, Evidence-Based Medicine, Guideline Adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review