The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Development of the AGREE II, part 1: performance, usefulness and areas for improvement
Open accessAbstract
BACKGROUND: We undertook research to improve the AGREE instrument, a tool used to evaluate guidelines. We tested a new seven-point scale, evaluated the usefulness of the original items in the instrument, investigated evidence to support shorter, tailored versions of the tool, and identified areas for improvement. METHOD: We report on one component of a larger study that used a mixed design with four factors (user type, clinical topic, guideline and condition). For the analysis reported in this article, we asked participants to read a guideline and use the AGREE items to evaluate it based on a seven-point scale, to complete three outcome measures related to adoption of the guideline, and to provide feedback on the instrument's usefulness and how to improve it. RESULTS: Guideline developers gave lower-quality ratings than did clinicians or policy-makers. Five of six domains were significant predictors of participants' outcome measures (p < 0.05). All domains and items were rated as useful by stakeholders (mean scores > 4.0) with no significant differences by user type (p > 0.05). Internal consistency ranged between 0.64 and 0.89. Inter-rater reliability was satisfactory. We received feedback on how to improve the instrument. INTERPRETATION: Quality ratings of the AGREE domains were significant predictors of outcome measures associated with guideline adoption: guideline endorsements, overall intentions to use guidelines, and overall quality of guidelines. All AGREE items were assessed as useful in determining whether a participant would use a guideline. No clusters of items were found more useful by some users than others. The measurement properties of the seven-point scale were promising. These data contributed to the refinements and release of the AGREE II.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Self-citationClinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Health Measurement Scales: A Practical Guide to Their Development and Use
Vogelzang, J. L. (2015) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2015.03.007 · Cited by 2,337
(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
Clinical practice guidelines : directions for a new program
Field, M. J., & Lohr, K. N. (1990) · Cited by 1,415
Shaneyfelt, T. M., Mayo-Smith, M. F., & Rothwangl, J. (1999) · JAMA · doi:10.1001/jama.281.20.1900 · Cited by 844
AGREE II: advancing guideline development, reporting, and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.08.005 · Cited by 758
Self-citationPractice guidelines developed by specialty societies: the need for a critical appraisal
Grilli, R., Magrini, N., Penna, A., Mura, G., & Liberati, A. (2000) · The Lancet · doi:10.1016/s0140-6736(99)02171-6 · Cited by 664
Health measurement scales. A practical guide to their development and use, 3rd ed
Rajmil, L. (2005) · Europe PMC (PubMed Central) · Cited by 567
Cited by
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Self-citationTremblay, M. S., Carson, V., Chaput, J.-P., Connor Gorber, S., Dinh, T., Duggan, M., Faulkner, G., Gray, C. E., Gruber, R., Janson, K., et al. (2016) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2016-0151 · Cited by 2,024
“The guideline development procedures used here followed comprehensive, rigorous, and transparent processes (Brouwers et al. 2010a; Guyatt et al. 2011; Tremblay and Haskell 2012) incorporating systematic review findings, consultation findings, compositional analysis findings, and expert,…”
MethodInfluentialSelf-citationNew Canadian Physical Activity Guidelines
Tremblay, M. S., Warburton, D. E. R., Janssen, I., Paterson, D. H., Latimer, A. E., Rhodes, R. E., Kho, M. E., Hicks, A., LeBlanc, A. G., Zehr, L., et al. (2011) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/h11-009 · Cited by 1,238
Self-citationAGREE II: advancing guideline development, reporting, and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.08.005 · Cited by 758
Self-citationSchünemann, H. J., Wiercioch, W., Etxeandia, I., Falavigna, M., Santesso, N., Mustafa, R., Ventresca, M., Brignardello-Petersen, R., Laisaar, K.-T., Kowalski, S., et al. (2014) · Canadian Medical Association Journal · doi:10.1503/cmaj.131237 · Cited by 686
Metadata
- Authors
- Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Hanna, S. E., Makarski, J., & for the AGREE Next Steps Consortium
- Venue
- Canadian Medical Association Journal
- Publisher
- CMA Impact Inc.
- Published
- 2010-05-31
- Volume
- 182
- Issue
- 10
- Pages
- 1045-1052
- ISSN
- 0820-3946 (ISSN-L)
- 1488-2329
- OpenAlex
- W2140726322
- Cited by
- 499
- References
- 17
- FWCI
- 27.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development of the AGREE II, part 1: performance, usefulness and areas for improvement. https://app.cochat.ai/papers/10.1503/cmaj.091714
- The paper
- Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Hanna, S. E., Makarski, J., & for the AGREE Next Steps Consortium. (2010). Development of the AGREE II, part 1: performance, usefulness and areas for improvement. Canadian Medical Association Journal. https://doi.org/10.1503/cmaj.091714
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
