The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Pitfalls of Converting Practice Guidelines Into Quality Measures: Lessons Learned From a VA Performance Measure
Abstract
The Department of Veterans Affairs (VA) manages the largest health care system in the United States, and the Institute of Medicine has recommended that many practices of VA quality measurement be applied to the US health care system as a whole. The VA measures quality of care at all of its sites by assessing adherence rates to performance measures, which generally are derived from evidence-based practice guidelines. Higher adherence rates are used as evidence of better quality of care. However, there are problems with converting practice guidelines, intended to offer guidance to clinicians, into performance measures that are meant to identify poor-quality care. We suggest a more balanced perspective on the use of performance measures to define quality by delineating conceptual problems with the conversion of practice guidelines into quality measures. Focusing on colorectal cancer screening, we use a case study at 1 VA facility to illustrate pitfalls that can cause adherence rates to guideline-based performance measures to be poor indicators of the quality of cancer screening. Pitfalls identified included (1) not properly considering illness severity of the sample population audited for adherence to screening, (2) not distinguishing screening from diagnostic procedures when setting achievable target screening rates, and (3) not accounting for patient preferences or clinician judgment when scoring performance measures. For many patients with severe comorbid illnesses or strong preferences against screening, the risks of colorectal cancer screening outweigh the benefits, and the decision to not screen may reflect good quality of care. Performance measures require more thoughtful specification and interpretation to avoid defining high testing rates as good quality of care regardless of who received the test, why it was performed, or whether the patient wanted it.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cancer Screening in Elderly Patients: A Framework for Individualized Decision Making
Walter, L. C., & Covinsky, K. E. (2001) · JAMA · doi:10.1001/jama.285.21.2750 · Cited by 1,003
Self-citationAchievable benchmarks of care: the ABCTMs of benchmarking
Weissman, N. W., Allison, J. J., Kiefe, C. I., Farmer, R. M., Weaver, M. T., Williams, O. D., Child, I. G., Pemberton, J. H., Brown, K. C., & Baker, C. S. (1999) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.1999.00203.x · Cited by 167
Cited by
Boyd, C. M., Darer, J., Boult, C., Fried, L. P., Boult, L., & Wu, A. W. (2005) · JAMA · doi:10.1001/jama.294.6.716 · Cited by 2,581
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
Public Reporting and Pay for Performance in Hospital Quality Improvement
Lindenauer, P. K., Remus, D., Roman, S., Rothberg, M. B., Benjamin, E. M., Ma, A., & Bratzler, D. W. (2007) · New England Journal of Medicine · doi:10.1056/nejmsa064964 · Cited by 854
The Unintended Consequences of Publicly Reporting Quality Information
Werner, R. M. (2005) · JAMA · doi:10.1001/jama.293.10.1239 · Cited by 603
Evidence‐Based Medicine, Heterogeneity of Treatment Effects, and the Trouble with Averages
KRAVITZ, R. L., DUAN, N., & BRASLOW, J. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00327.x · Cited by 602
Metadata
- Authors
- Walter, L. C., Davidowitz, N. P., Heineken, P. A., & Covinsky, K. E.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2004-05-26
- Volume
- 291
- Issue
- 20
- Pages
- 2466
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2076296817
- Cited by
- 199
- References
- 2
- FWCI
- 50.99
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pitfalls of Converting Practice Guidelines Into Quality Measures: Lessons Learned From a VA Performance Measure. https://app.cochat.ai/papers/10.1001/jama.291.20.2466
- The paper
- Walter, L. C., Davidowitz, N. P., Heineken, P. A., & Covinsky, K. E. (2004). Pitfalls of Converting Practice Guidelines Into Quality Measures: Lessons Learned From a VA Performance Measure. JAMA. https://doi.org/10.1001/jama.291.20.2466
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.