The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Development and application of a generic methodology to assess the quality of clinical guidelines
Abstract
BACKGROUND: Despite clinical guidelines penetrating every aspect of clinical practice and health policy, doubts persist over their ability to improve patient care. We have designed and tested a generic critical appraisal instrument, that assesses whether developers have minimized the biases inherent in creating guidelines, and addressed the requirements for effective implementation. DESIGN: Thirty-seven items describing suggested predictors of guideline quality were grouped into three dimensions covering the rigour of development, clarity of presentation (including the context and content) and implementation issues. The ease of use, reliability and validity of the instrument was tested on a national sample of guidelines for the management of asthma, breast cancer, depression and coronary heart disease, with 120 appraisers. A numerical score was derived to allow comparison of guidelines within and between diseases. RESULTS: The instrument has acceptable reliability (Cronbach's alpha coefficient, 0.68-0.84; intra-class correlation coefficient, (0.82-0.90)). The results provided some evidence of validity (Pearson's correlation coefficient between appraisers' dimension scores and their global assessment was 0.49 for dimension one, 0.63 for dimension two and 0.40 for dimension three). The instrument could differentiate between national and local guidelines and was easy to apply. There was variation in the performance of guidelines with most not achieving a majority of criteria in each dimension. CONCLUSIONS: Use of this instrument should encourage developers to create guidelines that reflect relevant research evidence more accurately. Potential users or groups adapting guidelines for local use could apply the instrument to help decide which one to follow. The National Health Service Executive is using the instrument to assist in deciding which guidelines to recommend to the UK National Health Service. This methodology forms the basis of a common approach to assessing guideline quality in Europe.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Statistics notes: Cronbach's alpha: Table 1
Bland, J. M., & Altman, D. G. (1997) · BMJ · doi:10.1136/bmj.314.7080.572 · Cited by 5,300
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
Self-citationWhy we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Health Measurement Scales: A Practical Guide To Their Development And Use
Streiner, D. L., & Norman, G. R. (2003) · doi:10.1093/oso/9780198528470.001.0001 · Cited by 1,460
Guidelines for Clinical Practice: From Development to Use
(1992) · National Academies Press eBooks · doi:10.17226/1863 · Cited by 915
Maxwell, R. J. (1984) · BMJ · doi:10.1136/bmj.288.6428.1470 · Cited by 513
Implementing findings of research
Haines, A., & Jones, R. (1994) · BMJ · doi:10.1136/bmj.308.6942.1488 · Cited by 392
The Criteria and Standards of Quality: Explorations in Quality Assessment and Monitoring
Shortell, S. M. (1984) · Medical Care · doi:10.1097/00005650-198409000-00013 · Cited by 81
Ward, J., & Grieco, V. (1996) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1996.tb138645.x · Cited by 67
Cited by
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Boyd, C. M., Darer, J., Boult, C., Fried, L. P., Boult, L., & Wu, A. W. (2005) · JAMA · doi:10.1001/jama.294.6.716 · Cited by 2,581
(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
Rotter, T., Kinsman, L., James, E. L., Machotta, A., Gothe, H., Willis, J., Snow, P., & Kugler, J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006632.pub2 · Cited by 800
Metadata
- Authors
- Cluzeau, F., Littlejohns, P., Grimshaw, J., Feder, G., & Moran, S.
- Venue
- International Journal for Quality in Health Care
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-02-01
- Volume
- 11
- Issue
- 1
- Pages
- 21-28
- ISSN
- 1353-4505 (ISSN-L)
- 1464-3677
- OpenAlex
- W2151820683
- Cited by
- 271
- References
- 15
- FWCI
- 17.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and application of a generic methodology to assess the quality of clinical guidelines. https://app.cochat.ai/papers/10.1093/intqhc/11.1.21
- The paper
- Cluzeau, F., Littlejohns, P., Grimshaw, J., Feder, G., & Moran, S. (1999). Development and application of a generic methodology to assess the quality of clinical guidelines. International Journal for Quality in Health Care. https://doi.org/10.1093/intqhc/11.1.21
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.