The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
The Unreliability of Individual Physician "Report Cards" for Assessing the Costs and Quality of Care of a Chronic Disease
Abstract
CONTEXT: Physician profiling is widely used by many health care systems, but little is known about the reliability of commonly used profiling systems. OBJECTIVES: To determine the reliability of a set of physician performance measures for diabetes care, one of the most common conditions in medical practice, and to examine whether physicians could substantially improve their profiles by preferential patient selection. DESIGN AND SETTING: Cohort study performed from 1990 to 1993 at 3 geographically and organizationally diverse sites, including a large staff-model health maintenance organization, an urban university teaching clinic, and a group of private-practice physicians in an urban area. PARTICIPANTS: A total of 3642 patients with type 2 diabetes cared for by 232 different physicians. MAIN OUTCOME MEASURES: Physician profiles for their patients' hospitalization and clinic visit rates, total laboratory resource utilization rate and level of glycemic control by average hemoglobin A1c level with and without detailed case-mix adjustment. RESULTS: For profiles based on hospitalization rates, visit rates, laboratory utilization rates, and glycemic control, 4% or less of the overall variance was attributable to differences in physician practice and the reliability of the median physician's case-mix-adjusted profile was never better than 0.40. At this low level of physician effect, a physician would need to have more than 100 patients with diabetes in a panel for profiles to have a reliability of 0.80 or better (while more than 90% of all primary care physicians at the health maintenance organization had fewer than 60 patients with diabetes). For profiles of glycemic control, high outlier physicians could dramatically improve their physician profile simply by pruning from their panel the 1 to 3 patients with the highest hemoglobin A1c levels during the prior year. This advantage from gaming could not be prevented by even detailed case-mix adjustment. CONCLUSIONS: Physician "report cards" for diabetes, one of the highest-prevalence conditions in medical practice, were unable to detect reliably true practice differences within the 3 sites studied. Use of individual physician profiles may foster an environment in which physicians can most easily avoid being penalized by avoiding or deselecting patients with high prior cost, poor adherence, or response to treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Reliability and Validity Assessment
(2011) · The Encyclopedia of Political Science · doi:10.4135/9781608712434.n1341 · Cited by 5,040
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
Measuring Health: A Guide to Rating Scales and Questionnaires
McDowell, I., & Newell, C. (1987) · Cited by 4,207
Schuenemeyer, J. H., McCullagh, P., & Nelder, J. A. (1992) · Technometrics · doi:10.2307/1269238 · Cited by 2,667
Estimation with Quadratic Loss
James, W., & Stein, C. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_30 · Cited by 2,252
Measuring Health: A guide to rating scales and questionnaires
McDowell, I. (2006) · doi:10.1093/acprof:oso/9780195165678.001.0001 · Cited by 2,095
INADMISSIBILITY OF THE USUAL ESTIMATOR FOR THE MEAN OF A MULTIVARIATE NORMAL DISTRIBUTION
Stein, C. (1956) · Contribution to the Theory of Statistics · doi:10.1525/9780520313880-018 · Cited by 1,841
Report Cards on Cardiac Surgeons — Assessing New York State's Approach
Green, J., & Wintfeld, N. (1995) · New England Journal of Medicine · doi:10.1056/nejm199505043321812 · Cited by 386
Bravo, G., & Potvin, L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90076-l · Cited by 316
Mant, J., & Hicks, N. (1995) · BMJ · doi:10.1136/bmj.311.7008.793 · Cited by 303
Adjusting capitation rates using objective health measures and prior utilization.
Newhouse, J. P., Manning, W. G., Keeler, E. B., & Sloss, E. M. (1989) · PubMed Central · Cited by 243
Hayward, R. A. (1997) · JAMA · doi:10.1001/jama.1997.03550200039029 · Cited by 202
Kerr, E. A., Mittman, B. S., Hays, R. D., Siu, A. L., Leake, B., & Brook, R. H. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-123-7-199510010-00004 · Cited by 168
The Use and Abuse of Practice Profiles
Kassirer, J. P. (1994) · New England Journal of Medicine · doi:10.1056/nejm199403033300910 · Cited by 157
Vijan, S. S., Stevens, D. L., Herman, W. H., Funnell, M. M., & Standiford, C. J. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.07111.x · Cited by 122
Development and testing of a new measure of case mix for use in office practice.
Greenfield, S., SULLIVAN, L. M., Dukes, K. A., Silliman, R. A., D’Agostino, R. B., & Kaplan, S. H. (1995) · PubMed · Cited by 120
Selection bias in HMOs and PPOs: a review of the evidence.
Hellinger, F. J. (1995) · PubMed · Cited by 103
Physician Profiling -- An Analysis of Inpatient Practice Patterns in Florida and Oregon
Welch, H. G., Miller, M. E., & Welch, W. P. (1994) · New England Journal of Medicine · doi:10.1056/nejm199403033300906 · Cited by 93
Variation in the Delivery of Health Care: The Stakes Are High
Wennberg, D. E. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-128-10-199805150-00012 · Cited by 90
Greenfield, S., Kaplan, S. H., Silliman, R. A., SULLIVAN, L. M., Manning, W. D., D’Agostino, R. B., Singer, D. E., & Nathan, D. (1994) · PubMed · Cited by 61
The Evolution of Physician Credentialing into Managed Care Selective Contracting
Blum, J. D. (1996) · American Journal of Law & Medicine · doi:10.1017/s0098858800007814 · Cited by 20
Estimating Physician Costliness
Miller, M. E., Hui, S. L., Tierney, W. M., & McDonald, C. J. (1993) · Medical Care · doi:10.1097/00005650-199305001-00004 · Cited by 18
Cited by
Boyd, C. M., Darer, J., Boult, C., Fried, L. P., Boult, L., & Wu, A. W. (2005) · JAMA · doi:10.1001/jama.294.6.716 · Cited by 2,581
Inequality in Quality: Addressing Socioeconomic, Racial, and Ethnic Disparities in Health Care
Fiscella, K., Franks, P., Gold, M. R., & Clancy, C. M. (2000) · JAMA · doi:10.1001/jama.283.19.2579 · Cited by 1,183
Complications, Failure to Rescue, and Mortality With Major Inpatient Surgery in Medicare Patients
Ghaferi, A. A., Birkmeyer, J. D., & Dimick, J. B. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e3181bef697 · Cited by 807
Is More Information Better? The Effects of “Report Cards” on Health Care Providers
Dranove, D., Kessler, D., McClellan, M., & Satterthwaite, M. (2003) · Journal of Political Economy · doi:10.1086/374180 · Cited by 666
Grol, R. (2001) · JAMA · doi:10.1001/jama.286.20.2578 · Cited by 594
Metadata
- Authors
- Hofer, T. P.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 1999-06-09
- Volume
- 281
- Issue
- 22
- Pages
- 2098
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2155130216
- Cited by
- 502
- References
- 25
- FWCI
- 70.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.