Assessing Validity of ICD‐9‐CM and ICD‐10 Administrative Data in Recording Clinical Conditions in a Unique Dually Coded Database
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Objective. The goal of this study was to assess the validity of the International Classification of Disease, 10th Version (ICD‐10) administrative hospital discharge data and to determine whether there were improvements in the validity of coding for clinical conditions compared with ICD‐9 Clinical Modification (ICD‐9‐CM) data. Methods. We reviewed 4,008 randomly selected charts for patients admitted from January 1 to June 30, 2003 at four teaching hospitals in Alberta, Canada to determine the presence or absence of 32 clinical conditions and to assess the agreement between ICD‐10 data and chart data. We then recoded the same charts using ICD‐9‐CM and determined the agreement between the ICD‐9‐CM data and chart data for recording those same conditions. The accuracy of ICD‐10 data relative to chart data was compared with the accuracy of ICD‐9‐CM data relative to chart data. Results. Sensitivity values ranged from 9.3 to 83.1 percent for ICD‐9‐CM and from 12.7 to 80.8 percent for ICD‐10 data. Positive predictive values ranged from 23.1 to 100 percent for ICD‐9‐CM and from 32.0 to 100 percent for ICD‐10 data. Specificity and negative predictive values were consistently high for both ICD‐9‐CM and ICD‐10 databases. Of the 32 conditions assessed, ICD‐10 data had significantly higher sensitivity for one condition and lower sensitivity for seven conditions relative to ICD‐9‐CM data. The two databases had similar sensitivity values for the remaining 24 conditions. Conclusions. The validity of ICD‐9‐CM and ICD‐10 administrative data in recording clinical conditions was generally similar though validity differed between coding versions for some conditions. The implementation of ICD‐10 coding has not significantly improved the quality of administrative data relative to ICD‐9‐CM. Future assessments like this one are needed because the validity of ICD‐10 data may get better as coders gain experience with the new coding system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
Self-citationComorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality
Sundararajan, V., Henderson, T., Perry, C., Muggivan, A., Quan, H., & Ghali, W. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.012 · Cited by 2,439
Self-citationMeasuring Diagnoses: ICD Code Accuracy
O'Malley, K. J., Cook, K. F., Price, M. D., Wildes, K. R., Hurdle, J. F., & Ashton, C. M. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00444.x · Cited by 1,116
Kokotailo, R. A., & Hill, M. D. (2005) · Stroke · doi:10.1161/01.str.0000174293.17959.a1 · Cited by 709
Jollis, J. G., Ancukiewicz, M., DeLong, E. R., Pryor, D. B., Muhlbaier, L. H., & Mark, D. B. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-119-8-199310150-00011 · Cited by 625
Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data
Quan, H., Parsons, G. A., & Ghali, W. A. (2002) · Medical Care · doi:10.1097/00005650-200208000-00007 · Cited by 579
Self-citationSouthern, D. A., Quan, H., & Ghali, W. A. (2004) · Medical Care · doi:10.1097/01.mlr.0000118861.56848.ee · Cited by 573
Self-citationQuality of Diagnosis and Procedure Coding in ICD-10 Administrative Data
Henderson, T., Shepheard, J., & Sundararajan, V. (2006) · Medical Care · doi:10.1097/01.mlr.0000228018.48783.34 · Cited by 406
Needham, D. M., Scales, D. C., Laupacis, A., & Pronovost, P. J. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2004.09.007 · Cited by 369
Lee, D. S., Donovan, L., Austin, P. C., Gong, Y., Liu, P. P., Rouleau, J. L., & Tu, J. V. (2005) · Medical Care · doi:10.1097/00005650-200502000-00012 · Cited by 358
Bias in the Coding of Hospital Discharge Data and Its Implications for Quality Assessment
Romano, P. S., & Mark, D. H. (1994) · Medical Care · doi:10.1097/00005650-199401000-00006 · Cited by 346
Weingart, S. N., Iezzoni, L. I., Davis, R. B., Palmer, R. H., Cahalane, M., Hamel, M. B., Mukamal, K., Phillips, R. S., Davies, D. T., & Banks, N. J. (2000) · Medical Care · doi:10.1097/00005650-200008000-00004 · Cited by 289
Accuracy of obstetric diagnoses and procedures in hospital discharge data
Yasmeen, S., Romano, P. S., Schembri, M. E., Keyzer, J. M., & Gilbert, W. M. (2006) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2005.08.058 · Cited by 287
Best, W. R., Khuri, S. F., Phelan, M., Hur, K., Henderson, W. G., Demakis, J. G., & Daley, J. (2002) · Journal of the American College of Surgeons · doi:10.1016/s1072-7515(01)01183-8 · Cited by 259
Medicare Reimbursement Accuracy Under the Prospective Payment System, 1985 to 1988
Hsia, D. C. (1992) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1992.03490070078046 · Cited by 163
Coding of Acute Myocardial Infarction: Clinical and Policy Implications
Iezzoni, L. I., Burnside, S., Sickles, L., Moskowitz, M. A., Sawitz, E., & Levine, P. A. (1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-109-9-745 · Cited by 142
Janssen, F., & Kunst, A. E. (2004) · Europe PMC (PubMed Central) · Cited by 138
Illness Severity and Costs of Admissions at Teaching and Nonteaching Hospitals
Iezzoni, L. I., Shwartz, M., Moskowitz, M. A., Ash, A. S., Sawitz, E., & Burnside, S. (1990) · JAMA · doi:10.1001/jama.1990.03450110072030 · Cited by 130
Illness severity and costs of admissions at teaching and nonteaching hospitals.
Iezzoni, L. I., Shwartz, M., Moskowitz, M. A., et al. (1990) · PubMed · Cited by 124
Comparison of survey and physician claims data for detecting hypertension
Muhajarine, N., Mustard, C., Roos, L. L., Young, T. K., & Gelskey, D. E. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00019-x · Cited by 113
Anderson, R. N., & Rosenberg, H. M. (2003) · Statistics in Medicine · doi:10.1002/sim.1511 · Cited by 90
Geraci, J. M., Ashton, C. M., Kuykendall, D. H., Johnson, M. L., & Wu, L. (1997) · Medical Care · doi:10.1097/00005650-199706000-00005 · Cited by 87
Cited by
Quan, H., Li, B., Couris, C. M., Fushimi, K., Graham, P., Hider, P., Januel, J.-M., & Sundararajan, V. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq433 · Cited by 5,843
Self-citationvan Walraven, C., Austin, P. C., Jennings, A., Quan, H., & Forster, A. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819432e5 · Cited by 2,200
Self-citationGroenewegen, A., Rutten, F. H., Mosterd, A., & Hoes, A. W. (2020) · European Journal of Heart Failure · doi:10.1002/ejhf.1858 · Cited by 2,043
Validity of diagnoses, procedures, and laboratory data in Japanese administrative data
Yamana, H., Moriwaki, M., Horiguchi, H., Kodan, M., Fushimi, K., & Yasunaga, H. (2017) · Journal of Epidemiology · doi:10.1016/j.je.2016.09.009 · Cited by 884
Jernberg, T., Hasvold, P., Henriksson, M., Hjelm, H., Thuresson, M., & Janzon, M. (2015) · European Heart Journal · doi:10.1093/eurheartj/ehu505 · Cited by 875
Metadata
- Authors
- Quan, H., Li, B., Duncan Saunders, L., Parsons, G. A., Nilsson, C. I., Alibhai, A., Ghali, W. A., & for the IMECCHI Investigators
- Venue
- Health Services Research
- Publisher
- Wiley
- Published
- 2008-07-16
- Volume
- 43
- Issue
- 4
- Pages
- 1424-1441
- ISSN
- 0017-9124 (ISSN-L)
- 1475-6773
- OpenAlex
- W1582456500
- Cited by
- 892
- References
- 25
- FWCI
- 35.46
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.