A COMPARISON OF CLINICAL PRACTICE GUIDELINE APPRAISAL INSTRUMENTS
The DOI matches its Crossref record.
Abstract
OBJECTIVE: To identify and compare clinical practice guideline appraisal instruments. METHODS: Appraisal instruments, defined as instruments intended to be used for guideline evaluation, were identified by searching MEDLINE (1966-99) using the Medical Subject Heading (MeSH) practice guidelines, reviewing bibliographies of the retrieved articles, and contacting authors of guideline appraisal instruments. Two reviewers independently examined the questions/statements from all the instruments and thematically grouped them. The 44 groupings were collapsed into 10 guideline attributes. Using the items, two reviewers independently undertook a content analysis of the instruments. RESULTS: Fifteen instruments were identified, and two were excluded because they were not focused on evaluation. All instruments were developed after 1992 and contained 8 to 142 questions/statements. Of the 44 items used for the content analysis, the number of items covered by each instrument ranged from 6 to 34. Only the instrument by Cluzeau and colleagues included at least one item for each of the 10 attributes, and it addressed 28 of the 44 items. This instrument and that of Shaneyfelt et al. are the only instruments that have so far been validated. CONCLUSIONS: A comprehensive, concise, and valid instrument could help users systematically judge the quality and utility of clinical practice guidelines. The current instruments vary widely in length and comprehensiveness. There is insufficient evidence to support the exclusive use of any one instrument, although the Cluzeau instrument has received the greatest evaluation. More research is required on the reliability and validity of existing guideline appraisal instruments before any one instrument can become widely adopted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Boyd, C. M., Darer, J., Boult, C., Fried, L. P., Boult, L., & Wu, A. W. (2005) · JAMA · doi:10.1001/jama.294.6.716 · Cited by 2,581
Shiffman, R. N., Shekelle, P., Overhage, J. M., Slutsky, J., Grimshaw, J., & Deshpande, A. M. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-6-200309160-00013 · Cited by 451
Shiffman, R. N., Dixon, J., Brandt, C., Essaihi, A., Hsiao, A., Michel, G., & O'Connell, R. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-23 · Cited by 389
Vlayen, J., Aertgeerts, B., Hannes, K., Sermeus, W., & Ramaekers, D. (2005) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzi027 · Cited by 313
Appraisal Tools for Clinical Practice Guidelines: A Systematic Review
Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082915 · Cited by 233
“We used the questions and statements contained in the appraisal tools, as well as the publications by Cluzeau 1999 [60], Graham 2000 [58] and Vlayen 2008 [59], to identify items and quality dimensions.”
BackgroundMethodInfluentialOrganizational Encounters with Risk
(2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511488580 · Cited by 189
Evaluation and adaptation of clinical practice guidelines
Graham, I. D., & Harrison, M. B. (2005) · Evidence-Based Nursing · doi:10.1136/ebn.8.3.68 · Cited by 177
Self-citationImproving the use of research evidence in guideline development: 14. Reporting guidelines
Oxman, A. D., Schünemann, H. J., & Fretheim, A. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-26 · Cited by 55
Appleyard, T., Mann, C., & Khan, K. (2006) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2006.00937.x · Cited by 34
Metadata
- Authors
- Graham, I. D., Calder, L. A., Hébert, P. C., Carter, A. O., & Tetroe, J. M.
- Venue
- International Journal of Technology Assessment in Health Care
- Publisher
- Cambridge University Press (CUP)
- Published
- 2000-10
- Volume
- 16
- Issue
- 04
- Pages
- 1024-1038
- ISSN
- 0266-4623 (ISSN-L)
- 1471-6348
- OpenAlex
- W2014727734
- Cited by
- 131
- References
- 0
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.