The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Appraisal Tools for Clinical Practice Guidelines: A Systematic Review
Open accessAbstract
INTRODUCTION: Clinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools. METHODS: Among others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items. RESULTS: We identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions "evaluation of evidence" (mentioned in 35 tools; 88%), "presentation of guideline content" (34 tools; 85%), "transferability" (33 tools; 83%), "independence" (32 tools; 80%), "scope" (30 tools; 75%), and "information retrieval" (29 tools; 73%). The quality dimensions "consideration of different perspectives" and "dissemination, implementation and evaluation of the guideline" were covered by only twenty (50%) and eighteen tools (45%) respectively. CONCLUSIONS: Most guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 1×
“%) of the 235 studies included in their review reported improvements in health care [6,7].”
BackgroundBoyd, C. M., Darer, J., Boult, C., Fried, L. P., Boult, L., & Wu, A. W. (2005) · JAMA · doi:10.1001/jama.294.6.716 · Cited by 2,581 · cited 1×
“…conflicting recommendations [18-26], • insufficient consideration of relevant patient characteristics (e.g., multimorbidity or ethnic differences) [27-30], • low quality of the evidence underlying the recommendations [31-35], • lack of transparency of methods applied by guideline developers,…”
BackgroundPharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 1×
“Conflicts of interest may influence decisions in the health care system [76, 77], also concerning the development of guidelines [36-38], and new and more stringent policies have been called for [42, 55, 78-80].”
BackgroundGuidelines International Network: Toward International Standards for Clinical Practice Guidelines
Qaseem, A., Forland, F., Macbeth, F., Ollenschläger, G., Phillips, S., van der Wees, P., & for the Board of Trustees of the Guidelines International Network* (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-7-201204030-00009 · Cited by 902
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846 · cited 1×
“no / no no yes Calder 1997 [107] EN [60-62, 114, 115] no yes GL 26 (5) no no / yes / no 2 no / no no yes”
Als-Nielsen, B., Chen, W., Gluud, C., & Kjaergard, L. L. (2003) · JAMA · doi:10.1001/jama.290.7.921 · Cited by 746
Grilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392
Cited by
The ABC of systematic literature review: the basic methodological guidance for beginners
Mohamed Shaffril, H. A., Samsuddin, S. F., & Abu Samah, A. (2021) · Quality & Quantity · doi:10.1007/s11135-020-01059-6 · Cited by 656
Corp, N., Mansell, G., Stynes, S., Wynne‐Jones, G., Morsø, L., Hill, J. C., & van der Windt, D. A. (2021) · European Journal of Pain · doi:10.1002/ejp.1679 · Cited by 501
Guide to clinical practice guidelines: the current state of play
Kredo, T., Bernhardsson, S., Machingaidze, S., Young, T., Louw, Q., Ochodo, E., & Grimmer, K. (2016) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzv115 · Cited by 444
Montero-Odasso, M. M., Kamkar, N., Pieruccini-Faria, F., Osman, A., Sarquis-Adamson, Y., Close, J., Hogan, D. B., Hunter, S. W., Kenny, R. A., Lipsitz, L. A., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.38911 · Cited by 334
Systematic reviews of clinical practice guidelines: a methodological guide
Johnston, A., Kelly, S. E., Hsieh, S.-C., Skidmore, B., & Wells, G. A. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.11.030 · Cited by 273
Metadata
- Authors
- Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-12-09
- Volume
- 8
- Issue
- 12
- Pages
- e82915
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2035247702
- Cited by
- 233
- References
- 16
- FWCI
- 1.44
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Appraisal Tools for Clinical Practice Guidelines: A Systematic Review. https://app.cochat.ai/papers/10.1371/journal.pone.0082915
- The paper
- Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A. (2013). Appraisal Tools for Clinical Practice Guidelines: A Systematic Review. PLoS ONE. https://doi.org/10.1371/journal.pone.0082915
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.