The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies
Abstract
BACKGROUND: Despite the increasing number of manuals on how to develop clinical practice guidelines (CPGs) there remain concerns about their quality. The aim of this study was to review the quality of CPGs across a wide range of healthcare topics published since 1980. METHODS: The authors conducted a literature search in MEDLINE to identify publications assessing the quality of CPGs with the Appraisal of Guidelines, Research and Evaluation (AGREE) instrument. For the included guidelines in each study, the authors gathered data about the year of publication, institution, country, healthcare topic, AGREE score per domain and overall assessment. RESULTS: In total, 42 reviews were selected, including a total of 626 guidelines, published between 1980 and 2007, with a median of 25 CPGs. The mean scores were acceptable for the domain 'Scope and purpose' (64%; 95% CI 61.9 to 66.4) and 'Clarity and presentation' (60%; 95% CI 57.9 to 61.9), moderate for domain 'Rigour of development' (43%; 95% CI 41.0 to 45.2), and low for the other domains ('Stakeholder involvement' 35%; 95% CI 33.9 to 37.5, 'Editorial independence' 30%; 95% CI 27.9 to 32.3, and 'Applicability' 22%; 95% CI 20.4 to 23.9). From those guidelines that included an overall assessment, 62% (168/270) were recommended or recommended with provisos. There was a significant improvement over time for all domains, except for 'Editorial independence.' CONCLUSIONS: This review shows that despite some increase in quality of CPGs over time, the quality scores as measured with the AGREE Instrument have remained moderate to low over the last two decades. This finding urges guideline developers to continue improving the quality of their products. International collaboration could help increasing the efficiency of the process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
Clinical practice guidelines : directions for a new program
Field, M. J., & Lohr, K. N. (1990) · Cited by 1,415
Scientific evidence underlying the ACC/AHA clinical practice guidelines.
Tricoci, P. (2009) · JAMA · doi:10.1001/jama.2009.205 · Cited by 908
Shaneyfelt, T. M., Mayo-Smith, M. F., & Rothwangl, J. (1999) · JAMA · doi:10.1001/jama.281.20.1900 · Cited by 844
Zhang, W., Moskowitz, R. W., Nuki, G., Abramson, S., Altman, R. D., Arden, N., Bierma-Zeinstra, S., Brandt, K. D., Croft, P., Doherty, M., et al. (2007) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.06.014 · Cited by 796
Practice guidelines developed by specialty societies: the need for a critical appraisal
Grilli, R., Magrini, N., Penna, A., Mura, G., & Liberati, A. (2000) · The Lancet · doi:10.1016/s0140-6736(99)02171-6 · Cited by 664
Development of the AGREE II, part 1: performance, usefulness and areas for improvement
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Hanna, S. E., Makarski, J., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.091714 · Cited by 499
Self-citationBrouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Hanna, S. E., Makarski, J., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.091716 · Cited by 495
Self-citationShiffman, R. N., Shekelle, P., Overhage, J. M., Slutsky, J., Grimshaw, J., & Deshpande, A. M. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-6-200309160-00013 · Cited by 451
Cited by
Alonso-Coello, P., Schünemann, H. J., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Rada, G., Rosenbaum, S., et al. (2016) · BMJ · doi:10.1136/bmj.i2016 · Cited by 1,317
Self-citationWong, J. J., Côté, P., Sutton, D. A., Randhawa, K., Yu, H., Varatharajan, S., Goldgrub, R., Nordin, M., Gross, D. P., Shearer, H. M., et al. (2017) · European Journal of Pain · doi:10.1002/ejp.931 · Cited by 414
Murad, M. H. (2017) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2017.01.001 · Cited by 386
Nagler, E. V., Vanmassenhove, J., van der Veer, S. N., Nistor, I., Van Biesen, W., Webster, A. C., & Vanholder, R. (2014) · BMC Medicine · doi:10.1186/s12916-014-0231-1 · Cited by 309
Andrade, R., Pereira, R., van Cingel, R., Staal, J. B., & Espregueira-Mendes, J. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-100310 · Cited by 264
Metadata
- Authors
- Alonso-Coello, P., Irfan, A., Sola, I., Gich, I., Delgado-Noguera, M., Rigau, D., Tort, S., Bonfill, X., Burgers, J., & Schunemann, H.
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2010-12-01
- Volume
- 19
- Issue
- 6
- Pages
- e58-e58
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- OpenAlex
- W2140838980
- Cited by
- 472
- References
- 46
- FWCI
- 2.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. https://app.cochat.ai/papers/10.1136/qshc.2010.042077
- The paper
- Alonso-Coello, P., Irfan, A., Sola, I., Gich, I., Delgado-Noguera, M., Rigau, D., Tort, S., Bonfill, X., Burgers, J., & Schunemann, H. (2010). The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. BMJ Quality & Safety. https://doi.org/10.1136/qshc.2010.042077
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.