Validity of race and ethnicity codes in Medicare administrative data compared with gold-standard self-reported race collected during routine home health care visits
Open accessAbstract
Background: Misclassification of Medicare beneficiaries’ race/ethnicity in administrative data sources is frequently overlooked and a limitation in health disparities research. Objective: To compare the validity of 2 race/ethnicity variables found in Medicare administrative data [enrollment database (EDB) and Research Triangle Institute (RTI) race] against a gold-standard source also available in the Medicare data warehouse: the self-reported race/ethnicity variable on the home health Outcome and Assessment Information Set (OASIS). Subjects: Medicare beneficiaries over the age of 18 who received home health care in 2015 (N=4,243,090). Measures: Percent agreement, sensitivity, specificity, positive predictive value, and Cohen κ coefficient. Results: The EDB and RTI race variable have high validity for black race and low validity for American Indian/Alaskan Native race. Although the RTI race variable has better validity than the EDB race variable for other races, κ values suggest room for future improvements in classification of whites (0.90), Hispanics (0.87), Asian/Pacific Islanders (0.77), and American Indian/Alaskan Natives (0.44). Discussion: The status quo of using “good-enough for government” race/ethnicity variables contained in Medicare administrative data for minority health disparities research can be improved through the use of self-reported race/ethnicity data, available in the Medicare data warehouse. Health services and policy researchers should critically examine the source of race/ethnicity variables used in minority health and health disparities research. Future work to improve the accuracy of Medicare beneficiaries’ race/ethnicity data should incorporate and augment the self-reported race/ethnicity data contained in assessment and survey data, available within the Medicare data warehouse.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Jarrín et al suggested high validity for Black patients and low sensitivity for Hispanic and Asian patients in Medicare beneficiary data files.
“Further, although Medicare claims that data sources of race/ethnicity information are commonly used in reports and studies of health disparities,35,36 Jarrín et al37 suggested high validity for Black patients and low sensitivity for Hispanic and Asian patients in Medicare beneficiary data files.”
From Disparities in SGLT2 Inhibitor or Glucagon-Like Peptide 1 Receptor Agonist Initiation Among Medicare-Insured Adults With CKD in the United States (2023) · cites this paper as [37]
The Results (page not provided) report high sensitivity and specificity for identifying Black beneficiaries with both Medicare race variables. They report low Hispanic sensitivity for the EDB variable (36.2), but good sensitivity for the RTI variable (90.8); sensitivity for Asian/Pacific Islander beneficiaries is 62.6 and 74.7, respectively. The claim omits these differences between the data files, particularly for Hispanic beneficiaries. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
Characteristics And Spending Patterns Of Persistently High-Cost Medicare Patients
Figueroa, J. F., Zhou, X., & Jha, A. K. (2019) · Health Affairs · doi:10.1377/hlthaff.2018.05160 · Cited by 67 · see citing works
Flagged first, then by citations
Research works printed but not linked: 24
- [1]Perez-Stable EJ, Collins FS. Science visioning in minority health and health disparities. Am J Pub Health 2019; 109: S5. 30699033 PMC6356132
- [3]Jeffries N, Zaslavsky AM, Diez Roux AV, Methodological approaches to understanding causes of health disparities. Am J Pub Health 2019; 109: S28– S33. 30699015 PMC6356121
- [4]Duran DG, Perez-Stable EJ. Science visioning to advance the next generation of health disparities research. Am J Pub Health 2019; 109: S11– S3. 30699020 PMC6356136
- [5]Bilheimer LT, Sisk JE. Collecting adequate data on racial and ethnic disparities in health: The challenges continue. Health Affairs 2008; 27: 383– 91. 18332493
- [6]Ng JH, Ye F, Ward LM, Haffer SC, Scholle SH. Data on race, ethnicity, and language largely incomplete for managed care plan members. Health Aff (Millwood) 2017; 36: 548– 52. 28264958
- [7]Executive Office of the President Office of Management and Budget, Office of Information and Regulatory Affairs. Revisions to the standards for the classification of federal data on race and ethnicity. Washington, DC: Federal Register; 1997: 58782– 90.
- [9]Joynt Maddox KE, Chen LM, Zuckerman R, Epstein AM. Association between race, neighborhood, and Medicaid enrollment and outcomes in Medicare home health care. J Am Geriatr Soc 2018; 66: 239– 46. 28975604
- [10]Belanger E, Silver B, Meyers DJ, A retrospective study of administrative data to identify high-need Medicare beneficiaries at risk of dying and being hospitalized. J Gen Intern Med 2019. PMC6420563 30604120
- [11]Bierman AS, Lurie N, Collins KS, Eisenberg JM. Addressing racial and ethnic barriers to effective health care: The need for better data. Health Affairs 2002; 21: 91– 102. 12026007
- [12]Thomson GE, Mitchell, Willimams MB, eds. Examining the Health Disparities Research Plan of the National Institutes of Health: Unfinished Business. Washington, DC: National Academies Press; 2006. 21850786
- [13]Race, Ethnicity, and Language Data: Standardization for Health Care Quality Improvement. Washington, DC: The National Academies Press; 2009. 25032349
- [14]National Research Council. Eliminating Health Disparities: Measurement and Data Needs. Washington, DC: The National Academies Press; 2004 Pages 68– 72. 10.17226/10979. 25009872 · DOI
- [15]Filice CE, Joynt KE. Examining race and ethnicity information in Medicare administrative data. Med Care 2017; 55: e170– e6. 29135782
- [16]Li Y, Cai X, Glance LG. Disparities in 30-day rehospitalization rates among Medicare skilled nursing facility residents by race and site of care. Med Care 2015; 53: 1058– 65. 26492217 PMC4648673
- [17]Eicheldinger C, Bonito A. More accurate racial and ethnic codes for Medicare administrative data. Health Care Financ Rev 2008; 29: 27– 42. 18567241 PMC4195038
- [19]Lim E, Gandhi K, Davis J, Chen JJ. Prevalence of chronic conditions and multimorbidities in a geographically defined geriatric population with diverse races and ethnicities. J Aging Health 2018; 30: 421– 44. 27913765 PMC5634944
- [21]O’Connor M, Davitt JK. The Outcome and Assessment Information Set (OASIS): a review of validity and reliability. Home Health Care Serv Q 2012; 31: 267– 301. 23216513 PMC4529994
- [22]Cohen J A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20: 37– 46.
- [24]Waldo DR. Accuracy and bias of race/ethnicity codes in the Medicare Enrollment Database. Health Care Financing Review 2004; 26: 61– 72. 25371985 PMC4194866
- [25]Zaslavsky AM, Ayanian JZ, Zaborski LB. The validity of race and ethnicity in enrollment data for Medicare beneficiaries. Health Serv Res 2012; 47: 1300– 21. 22515953 PMC3349013
- [26]Haas A, Elliott MN, Dembosky JW, Imputation of race/ethnicity to enable measurement of HEDIS performance by race/ethnicity. Health Serv Res 2019; 54: 13– 30506674 PMC6338295
- [27]Dembosky JW, Haviland AM, Haas A, Indirect estimation of race/ethnicity for survey respondents who do not report race/ethnicity. Medical Care 2018. 30520838
- [28]Bykov K, Franklin JM, Toscano M, Evaluating cardiovascular health disparities using estimated race/ethnicity: A validation study. Med Care 2015; 53: 1050– 7. 26565524
- [29]Klein DJ, Elliott MN, Haviland AM, A comparison of methods for classifying and modeling respondents who endorse multiple racial/ethnic categories. Med Care 2019; 57(6): e-34– e41. 30439794
Cited by
Sorted by citations
Air Pollution and Mortality at the Intersection of Race and Social Class
Josey, K. P., Delaney, S. W., Wu, X., Nethery, R. C., DeSouza, P., Braun, D., & Dominici, F. (2023) · New England Journal of Medicine · doi:10.1056/nejmsa2300523 · Cited by 142 · see citing works
Halawa, O. A., Kolli, A., Oh, G., Mitchell, W. G., Glynn, R. J., Kim, D. H., Friedman, D. S., & Zebardast, N. (2022) · Ophthalmology · doi:10.1016/j.ophtha.2021.09.022 · Cited by 92 · see citing works
Brennan, M. B., Powell, W. R., Kaiksow, F., Kramer, J., Liu, Y., Kind, A. J. H., & Bartels, C. M. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.8399 · Cited by 87 · see citing works
Shannon, E. M., Zheng, J., Orav, E. J., Schnipper, J. L., & Mueller, S. K. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.3474 · Cited by 37 · see citing works
Cromer, S. J., Lauffenburger, J. C., Levin, R., & Patorno, E. (2023) · Diabetes Care · doi:10.2337/dc22-0383 · Cited by 36 · see citing works
Zhao, J. Z., Weinhandl, E. D., Carlson, A. M., & St. Peter, W. L. (2023) · Kidney Medicine · doi:10.1016/j.xkme.2022.100564 · Cited by 33 · see citing works
Disparities in 30‐day readmission rates among Medicare enrollees with dementia
Gilmore‐Bykovskyi, A., Zuelsdorff, M., Block, L., Golden, B., Kaiksow, F., Sheehy, A. M., Bartels, C. M., Kind, A. J. H., & Powell, W. R. (2023) · Journal of the American Geriatrics Society · doi:10.1111/jgs.18311 · Cited by 25 · see citing works
Ganguli, I., Lim, C., Daley, N., Cutler, D., Rosenthal, M., & Mehrotra, A. (2025) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2024.8354 · Cited by 16 · see citing works
Chen, W.-H., Li, Y., Yang, L., Allen, J. M., Shao, H., Donahoo, W. T., Billelo, L., Hu, X., Shenkman, E. A., Bian, J., et al. (2024) · PLOS ONE · doi:10.1371/journal.pone.0297208 · Cited by 17 · see citing works
Yelpaala, K., Gibbons, M. C., Vigil, I. M., Leaño, J., McCall, T., Opara, I., Zink, A., Nunez-Smith, M., Mukherjee, B., & Ranney, M. (2025) · Journal of Medical Internet Research · doi:10.2196/78794 · Cited by 6 · see citing works
- Authors
- Jarrín, O. F., Nyandege, A. N., Grafova, I. B., Dong, X., & Lin, H.
- Affiliations
- Division of Nursing Science, School of Nursing
- Institute for Health, Health Care Policy, and Aging Research
- Rutgers, The State University of New Jersey (US)
- Corresponding author
- Lin, Haiqun
- Venue
- Medical Care
- Published
- 2019-10-29
- Volume
- 58
- Issue
- 1
- Pages
- e1-e8
- ISSN
- 0025-7079 (ISSN-L)
- PMC
- PMC6904433
- OpenAlex
- W2986214232
- Cited by
- 347
- References
- 2
- Citations by year
- 2026: 30 · 2025: 66 · 2024: 62 · 2023: 75 · 2022: 70 · 2021: 37 · 2020: 6 · 2019: 1
- FWCI
- 31.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Medical Care (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Rutgers University Community Repository (Rutgers University) (submittedVersion)
- Funders
- Agency for Healthcare Research and Quality (R00 HS022406)
- National Institute of Nursing Research (R01NR014855)
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Race, Genetics, and Society
- Social Sciences › Health › Health disparities and outcomes
- Keywords
- self-reported race, home health care, OASIS, health disparities research, Black race, data validity
- MeSH terms
- Aged, Aged, 80 and over, Ethnicity, Female, Medicare, Home Care Services, Humans, Male, Predictive Value of Tests, Sensitivity and Specificity, United States, Reproducibility of Results, Outcome Assessment, Health Care, Racial Groups, Health Status Disparities, Healthcare Disparities, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review