The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
The accuracy of Medicare's hospital claims data: progress has been made, but problems remain.
Abstract
BACKGROUND. Health care databases provide a widely used source of data for health care research, but their accuracy remains uncertain. We analyzed data from the 1985 National DRG Validation Study, which carefully reabstracted and reassigned ICD-9-CM diagnosis and procedure codes from a national sample of 7050 medical records, to determine whether coding accuracy had improved since the Institute of Medicine studies of the 1970s and to assess the current coding accuracy of specific diagnoses and procedures. METHODS. We defined agreement as the proportion of all reabstracted records that had the same principal diagnosis or procedure coded on both the original (hospital) record and on the reabstracted record. We also evaluated coding accuracy in 1985 using the concepts of diagnostic test evaluation. RESULTS. Overall, the percentage of agreement between the principal diagnosis on the reabstracted record and the original hospital record, when analyzed at the third digit, improved from 73.2% in 1977 to 78.2% in 1985. However, analysis of the 1985 data demonstrated that the accuracy of diagnosis and procedure coding varies substantially across conditions. CONCLUSIONS. Although some diagnoses and all major surgical procedures that we examined were accurately coded, the variability in the accuracy of diagnosis coding poses a problem that must be overcome if claims-based research is to achieve its full potential.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wennberg, J., & Gittelsohn, A. (1973) · Science · doi:10.1126/science.182.4117.1102 · Cited by 1,876
Practical Nonparametric Statistics
Conover, W. J. (1971) · Cited by 1,465
Psychotropic Drug Use and the Risk of Hip Fracture
Ray, W. A., Griffin, M. R., Schaffner, W., Baugh, D. K., & Melton, L. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702123160702 · Cited by 1,000
McPherson, K., Wennberg, J. E., Hovind, O. B., & Clifford, P. (1982) · New England Journal of Medicine · doi:10.1056/nejm198211183072104 · Cited by 822
Roos, N. P., Wennberg, J. E., Malenka, D. J., Fisher, E. S., McPherson, K., Andersen, T. F., Cohen, M. M., & Ramsey, E. (1989) · New England Journal of Medicine · doi:10.1056/nejm198904273201705 · Cited by 649
Self-citationFrom the Health Care Financing Administration
Wilensky, G. R. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470200020007 · Cited by 635
Accuracy of Diagnostic Coding for Medicare Patients under the Prospective-Payment System
Hsia, D. C., Krushat, W. M., Fagan, A. B., Tebbutt, J. A., & Kusserow, R. P. (1988) · New England Journal of Medicine · doi:10.1056/nejm198802113180604 · Cited by 487
Self-citationRoper, W. L., Winkenwerder, W., Hackbarth, G. M., & Krakauer, H. (1988) · New England Journal of Medicine · doi:10.1056/nejm198811033191805 · Cited by 404
Race and sex differences in hip fracture incidence.
Farmer, M. E., White, L. R., Brody, J. A., & Bailey, K. R. (1984) · American Journal of Public Health · doi:10.2105/ajph.74.12.1374 · Cited by 394
SOX, H. C. (1986) · Annals of Internal Medicine · doi:10.7326/0003-4819-104-1-60 · Cited by 364
Cited by
Hospital Volume and Surgical Mortality in the United States
Birkmeyer, J. D., Siewers, A. E., Finlayson, E. V. A., Stukel, T. A., Lucas, F. L., Batista, I., Welch, H. G., & Wennberg, D. E. (2002) · New England Journal of Medicine · doi:10.1056/nejmsa012337 · Cited by 4,999
Surgeon Volume and Operative Mortality in the United States
Birkmeyer, J. D., Stukel, T. A., Siewers, A. E., Goodney, P. P., Wennberg, D. E., & Lucas, F. L. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa035205 · Cited by 3,106
Fine Particulate Air Pollution and Hospital Admission for Cardiovascular and Respiratory Diseases
Dominici, F., Peng, R. D., Bell, M. L., Pham, L., McDermott, A., Zeger, S. L., & Samet, J. M. (2006) · JAMA · doi:10.1001/jama.295.10.1127 · Cited by 2,634
Ray, N. F., Chan, J. K., Thamer, M., & Melton, L. J. (1997) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.1997.12.1.24 · Cited by 1,281
Validation of the national health insurance research database with ischemic stroke cases in Taiwan
Cheng, C., Kao, Y. Y., Lin, S., Lee, C., & Lai, M. L. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2087 · Cited by 1,277
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiss, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,277
Global association of air pollution and heart failure: a systematic review and meta-analysis
Shah, A. S., Langrish, J. P., Nair, H., McAllister, D. A., Hunter, A. L., Donaldson, K., Newby, D. E., & Mills, N. L. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60898-3 · Cited by 1,226
Measuring Diagnoses: ICD Code Accuracy
O'Malley, K. J., Cook, K. F., Price, M. D., Wildes, K. R., Hurdle, J. F., & Ashton, C. M. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00444.x · Cited by 1,116
Surgeon volume and operative mortality in the United States
Birkmeyer, J. D., Stukel, T. A., Siewers, A. E., Goodney, P. P., Wennberg, D. E., & Lucas, F. L. (2004) · ACC Current Journal Review · doi:10.1016/j.accreview.2003.12.065 · Cited by 1,113
Graham, D. J., Campen, D., Hui, R., Spence, M., Cheetham, C., Levy, G., Shoor, S., & Ray, W. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17864-7 · Cited by 913
Levitan, N., Dowlati, A., Remick, S. C., Tahsildar, H. I., Sivinski, L. D., Beyth, R., & Rimm, A. A. (1999) · Medicine · doi:10.1097/00005792-199909000-00001 · Cited by 891
National Trends in Rotator Cuff Repair
Colvin, A. C., Egorova, N., Harrison, A. K., Moskowitz, A., & Flatow, E. L. (2012) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.j.00739 · Cited by 742
Accuracy of ICD-9-CM Codes for Identifying Cardiovascular and Stroke Risk Factors
Birman-Deych, E., Waterman, A. D., Yan, Y., Nilasena, D. S., Radford, M. J., & Gage, B. F. (2005) · Medical Care · doi:10.1097/01.mlr.0000160417.39497.a9 · Cited by 719
Schneeweiss, S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.854 · Cited by 711
POTOSKY, A. L., RILEY, G. F., LUBITZ, J. D., MENTNECH, R. M., & KESSLER, L. G. (1993) · Medical Care · doi:10.1097/00005650-199308000-00006 · Cited by 694
Surveillance and ascertainment of cardiovascular events
Ives, D. G., Fitzpatrick, A. L., Bild, D. E., Psaty, B. M., Kuller, L. H., Crowley, P. M., Cruise, R. G., & Theroux, S. (1995) · Annals of Epidemiology · doi:10.1016/1047-2797(94)00093-9 · Cited by 688
Nonadherence to adjuvant tamoxifen therapy in women with primary breast cancer
Partridge, A. H., Wang, P. S., Winer, E. P., & Avorn, J. (2003) · Journal of Clinical Oncology · doi:10.1200/jco.2003.07.071 · Cited by 676
Adherence to Therapy With Oral Antineoplastic Agents
Partridge, A. H. (2002) · CancerSpectrum Knowledge Environment · doi:10.1093/jnci/94.9.652 · Cited by 584
Increased Pulse Pressure and Risk of Heart Failure in the Elderly
Chae, C. U. (1999) · JAMA · doi:10.1001/jama.281.7.634 · Cited by 582
Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data
Quan, H., Parsons, G. A., & Ghali, W. A. (2002) · Medical Care · doi:10.1097/00005650-200208000-00007 · Cited by 579
Kiyota, Y., Schneeweiss, S., Glynn, R. J., Cannuscio, C. C., Avorn, J., & Solomon, D. H. (2004) · American Heart Journal · doi:10.1016/j.ahj.2004.02.013 · Cited by 531
The Epidemiology of Diagnosed Pulmonary Embolism and Deep Venous Thrombosis in the Elderly
Kniffin, W. D. (1994) · Archives of Internal Medicine · doi:10.1001/archinte.154.8.861 · Cited by 529
Risk of Perforation After Colonoscopy and Sigmoidoscopy: A Population-Based Study
Gatto, N. M., Frucht, H., Sundararajan, V., Jacobson, J. S., Grann, V. R., & Neugut, A. I. (2003) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/95.3.230 · Cited by 522
Cheng, C.-L., Lee, C.-H., Chen, P.-S., Li, Y.-H., Lin, S.-J., & Yang, Y.-H. K. (2014) · Journal of Epidemiology · doi:10.2188/jea.je20140076 · Cited by 521
Oral Erythromycin and the Risk of Sudden Death from Cardiac Causes
Ray, W. A., Murray, K. T., Meredith, S., Narasimhulu, S. S., Hall, K., & Stein, C. M. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa040582 · Cited by 496
Hospital Volume and Operative Mortality in Cancer Surgery: A National Study
Finlayson, E. V. A. (2003) · Archives of Surgery · doi:10.1001/archsurg.138.7.721 · Cited by 484
Dementia Risk After Traumatic Brain Injury vs Nonbrain Trauma: The Role of Age and Severity
Gardner, R. C., Burke, J. F., Nettiksimmons, J., Kaup, A., Barnes, D. E., & Yaffe, K. (2014) · JAMA Neurology · doi:10.1001/jamaneurol.2014.2668 · Cited by 451
Identifying Complications of Care Using Administrative Data
Iezzoni, L. I., Daley, J., Heeren, T., Foley, S. M., Fisher, E. S., Duncan, C., Hughes, J. S., & Coffman, G. A. (1994) · Medical Care · doi:10.1097/00005650-199407000-00004 · Cited by 454
Self-citationHospital Volume and Operative Mortality in the Modern Era
Reames, B. N., Ghaferi, A. A., Birkmeyer, J. D., & Dimick, J. B. (2014) · Annals of Surgery · doi:10.1097/sla.0000000000000375 · Cited by 445
Mortality After Periprosthetic Fracture of the Femur
Bhattacharyya, T., Chang, D., Meigs, J. B., Estok, D. M., & Malchau, H. (2007) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.f.01538 · Cited by 427
Miller, D. R., Safford, M. M., & Pogach, L. M. (2004) · Diabetes Care · doi:10.2337/diacare.27.suppl_2.b10 · Cited by 425
Quality of Diagnosis and Procedure Coding in ICD-10 Administrative Data
Henderson, T., Shepheard, J., & Sundararajan, V. (2006) · Medical Care · doi:10.1097/01.mlr.0000228018.48783.34 · Cited by 406
The Role of Provider Continuity in Preventing Hospitalizations
Gill, J. M. (1998) · Archives of Family Medicine · doi:10.1001/archfami.7.4.352 · Cited by 384
Assessing Comorbidity Using Claims Data: An Overview
Klabunde, C. N., Warren, J. L., & Legler, J. M. (2002) · Medical Care · doi:10.1097/00005650-200208001-00004 · Cited by 382
Confounding Control in Healthcare Database Research: Challenges and Potential Approaches
Brookhart, M. A., Stürmer, T., Glynn, R. J., Rassen, J., & Schneeweiss, S. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181dbebe3 · Cited by 377
National Outcomes of Cataract Extraction
Javitt, J. C., Street, D. A., Tielsch, J. M., Wang, Q., Kolb, M. M., Schein, O., Sommer, A., Bergner, M., Steinberg, E. P., Steinberg, E. P., et al. (1994) · Ophthalmology · doi:10.1016/s0161-6420(13)31251-2 · Cited by 368
Quan, H., Parsons, G. A., & Ghali, W. A. (2004) · Medical Care · doi:10.1097/01.mlr.0000132391.59713.0d · Cited by 367
The Accuracy of Medicare Claims as an Epidemiological Tool: The Case of Dementia Revisited
Taylor, Jr., Østbye, T., Langa, K. M., Weir, D., & Plassman, B. L. (2009) · Journal of Alzheimer's Disease · doi:10.3233/jad-2009-1099 · Cited by 354
Clinical characteristics and economic costs of patients with painful neuropathic disorders
Berger, A., Dukes, E. M., & Oster, G. (2004) · The Journal of Pain · doi:10.1016/j.jpain.2003.12.004 · Cited by 351
Chronically Depressed Mood and Cancer Risk in Older Persons
Penninx, B. W. J. H., Guralnik, J. M., Havlik, R. J., Pahor, M., Ferrucci, L., Cerhan, J. R., & Wallace, R. B. (1998) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/90.24.1888 · Cited by 347
Bias in the Coding of Hospital Discharge Data and Its Implications for Quality Assessment
Romano, P. S., & Mark, D. H. (1994) · Medical Care · doi:10.1097/00005650-199401000-00006 · Cited by 346
Brookhart, M. A., Wang, P. S., Solomon, D. H., & Schneeweiss, S. (2006) · Epidemiology · doi:10.1097/01.ede.0000193606.58671.c5 · Cited by 341
Calcium-channel blockade and incidence of cancer in aged populations
Pahor, M., Guralnik, J. M., Ferrucci, L., Corti, M.-C., Salive, M. E., Cerhan, J. R., Wallace, R. B., & Havlik, R. J. (1996) · The Lancet · doi:10.1016/s0140-6736(96)04277-8 · Cited by 340
Improved Comorbidity Adjustment for Predicting Mortality in Medicare Populations
Schneeweiss, S., Wang, P. S., Avorn, J., & Glynn, R. J. (2003) · Health Services Research · doi:10.1111/1475-6773.00165 · Cited by 330
Outcomes in Octogenarians Undergoing High-Risk Cancer Operation: A National Study
Finlayson, E., Fan, Z., & Birkmeyer, J. D. (2007) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2007.06.307 · Cited by 329
Ray, W. A., Stein, C. M., Hall, K., Daugherty, J. R., & Griffin, M. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07370-1 · Cited by 326
Hospital Volume, Length of Stay, and Readmission Rates in High-Risk Surgery
Goodney, P. P., Stukel, T. A., Lucas, F. L., Finlayson, E. V. A., & Birkmeyer, J. D. (2003) · Annals of Surgery · doi:10.1097/01.sla.0000081094.66659.c3 · Cited by 314
Stange, K. C., Zyzanski, S. J., Smith, T. F., Kelly, R., Langa, D. M., Flocke, S. A., & Jaén, C. R. (1998) · Medical Care · doi:10.1097/00005650-199806000-00009 · Cited by 313
National Outcomes of Cataract Extraction
Javitt, J. C., Tielsch, J. M., Canner, J. K., Kolb, M. M., Sommer, A., Steinberg, E. P., Steinberg, E. P., Bergner, M., Sommer, A., Anderson, G. F., et al. (1992) · Ophthalmology · doi:10.1016/s0161-6420(92)31775-0 · Cited by 306
Infant and Maternal Outcomes in the Pregnancies of Asthmatic Women
DEMISSIE, K., BRECKENRIDGE, M. B., & RHOADS, G. G. (1998) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.158.4.9802053 · Cited by 293
Identifying dementia cases with routinely collected health data: a systematic review
Wilkinson, T., Ly, A., Schnier, C., Rannikmäe, K., Bush, K., Brayne, C., Quinn, T. J., Sudlow, C. L. M., & On behalf of the UK Biobank Neurodegenerative Outcomes Group and Dementias Platform UK (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.016 · Cited by 279
Goldberg, S. L., Chen, E., Corral, M., Guo, A., Mody-Patel, N., Pecora, A. L., & Laouri, M. (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2009.25.2395 · Cited by 289
Accuracy of obstetric diagnoses and procedures in hospital discharge data
Yasmeen, S., Romano, P. S., Schembri, M. E., Keyzer, J. M., & Gilbert, W. M. (2006) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2005.08.058 · Cited by 287
HDL Cholesterol Predicts Coronary Heart Disease Mortality in Older Persons
Corti, M.-C. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03530070037026 · Cited by 285
Monane, M. (1997) · American Journal of Hypertension · doi:10.1016/s0895-7061(97)00056-3 · Cited by 276
Do cancer centers designated by the National Cancer Institute have better surgical outcomes?
Birkmeyer, N. J. O., Goodney, P. P., Stukel, T. A., Hillner, B. E., & Birkmeyer, J. D. (2005) · Cancer · doi:10.1002/cncr.20785 · Cited by 269
Gastrostomy Placement and Mortality Among Hospitalized Medicare Beneficiaries
Grant, M. D. (1998) · JAMA · doi:10.1001/jama.279.24.1973 · Cited by 268
Kashner, T. M. (1998) · Medical Care · doi:10.1097/00005650-199809000-00005 · Cited by 264
Midlife Body Mass Index and Hospitalization and Mortality in Older Age
Yan, L. L. (2006) · JAMA · doi:10.1001/jama.295.2.190 · Cited by 260
Best, W. R., Khuri, S. F., Phelan, M., Hur, K., Henderson, W. G., Demakis, J. G., & Daley, J. (2002) · Journal of the American College of Surgeons · doi:10.1016/s1072-7515(01)01183-8 · Cited by 259
Use of SEER-Medicare Data for Measuring Cancer Surgery
Cooper, G. S., Virnig, B., Klabunde, C. N., Schussler, N., Freeman, J., & Warren, J. L. (2002) · Medical Care · doi:10.1097/00005650-200208001-00006 · Cited by 256
Goldberg, K. C. (1992) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1992.03480110049032 · Cited by 254
Progression of Peripheral Arterial Disease Predicts Cardiovascular Disease Morbidity and Mortality
Criqui, M. H., Ninomiya, J. K., Wingard, D. L., Ji, M., & Fronek, A. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.07.060 · Cited by 253
Monane, M., Bohn, R. L., Gurwitz, J. H., Glynn, R. J., Levin, R., & Avorn, J. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.12.1805 · Cited by 253
Nuttall, M., van der Meulen, J., & Emberton, M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.015 · Cited by 219
Recommendations for optimal ICD codes to study neurologic conditions: A systematic review
St. Germaine-Smith, C., Metcalfe, A., Pringsheim, T., Roberts, J. I., Beck, C. A., Hemmelgarn, B. R., McChesney, J., Quan, H., & Jette, N. (2012) · Neurology · doi:10.1212/wnl.0b013e3182684707 · Cited by 206
Tang, P. C., Ralston, M., Arrigotti, M. F., Qureshi, L., & Graham, J. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2198 · Cited by 193
Failure of ICD‐9‐CM Codes to Identify Patients with Comorbid Chronic Kidney Disease in Diabetes
Kern, E. F. O., Maney, M., Miller, D. R., Tseng, C., Tiwari, A., Rajan, M., Aron, D., & Pogach, L. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2005.00482.x · Cited by 165
Association between physical illness and suicide among the elderly
Quan, H., Arboleda-Flórez, J., Fick, G. H., Stuart, H. L., & Love, E. J. (2002) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270200014 · Cited by 156
Derrow, A. E., Seeger, J. M., Dame, D. A., Carter, R. L., Ozaki, C. K., Flynn, T. C., & Huber, T. S. (2001) · Journal of Vascular Surgery · doi:10.1067/mva.2001.115596 · Cited by 153
Utilization and Validity of the Dental Diagnostic System over Time in Academic and Private Practice
Yansane, A., Tokede, O., White, J., Etolue, J., McClellan, L., Walji, M., Obadan-Udoh, E., & Kalenderian, E. (2019) · JDR Clinical & Translational Research · doi:10.1177/2380084418815150 · Cited by 18
Metadata
- Authors
- Fisher, E. S., Whaley, F. S., Krushat, W. M., Malenka, D. J., Fleming, C., Baron, J. A., & Hsia, D. C.
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 1992-02
- Volume
- 82
- Issue
- 2
- Pages
- 243-248
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- OpenAlex
- W2104333617
- Cited by
- 709
- References
- 21
- FWCI
- 58.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.