Cited by 347Medical Coding and Health InformationRace, Genetics, and SocietyHealth disparities and outcomes

Validity of race and ethnicity codes in Medicare administrative data compared with gold-standard self-reported race collected during routine home health care visits

Open access
Jarrín, Olga F., Nyandege, Abner N., Grafova, Irina B., Dong, XinQi, Lin, Haiqun·2020·Medical Care

Abstract

Background: Misclassification of Medicare beneficiaries’ race/ethnicity in administrative data sources is frequently overlooked and a limitation in health disparities research. Objective: To compare the validity of 2 race/ethnicity variables found in Medicare administrative data [enrollment database (EDB) and Research Triangle Institute (RTI) race] against a gold-standard source also available in the Medicare data warehouse: the self-reported race/ethnicity variable on the home health Outcome and Assessment Information Set (OASIS). Subjects: Medicare beneficiaries over the age of 18 who received home health care in 2015 (N=4,243,090). Measures: Percent agreement, sensitivity, specificity, positive predictive value, and Cohen κ coefficient. Results: The EDB and RTI race variable have high validity for black race and low validity for American Indian/Alaskan Native race. Although the RTI race variable has better validity than the EDB race variable for other races, κ values suggest room for future improvements in classification of whites (0.90), Hispanics (0.87), Asian/Pacific Islanders (0.77), and American Indian/Alaskan Natives (0.44). Discussion: The status quo of using “good-enough for government” race/ethnicity variables contained in Medicare administrative data for minority health disparities research can be improved through the use of self-reported race/ethnicity data, available in the Medicare data warehouse. Health services and policy researchers should critically examine the source of race/ethnicity variables used in minority health and health disparities research. Future work to improve the accuracy of Medicare beneficiaries’ race/ethnicity data should incorporate and augment the self-reported race/ethnicity data contained in assessment and survey data, available within the Medicare data warehouse.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1097/mlr.0000000000001216

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Jarrín et al suggested high validity for Black patients and low sensitivity for Hispanic and Asian patients in Medicare beneficiary data files.

    “Further, although Medicare claims that data sources of race/ethnicity information are commonly used in reports and studies of health disparities,35,36 Jarrín et al37 suggested high validity for Black patients and low sensitivity for Hispanic and Asian patients in Medicare beneficiary data files.”

    From Disparities in SGLT2 Inhibitor or Glucagon-Like Peptide 1 Receptor Agonist Initiation Among Medicare-Insured Adults With CKD in the United States (2023) · cites this paper as [37]

    The Results (page not provided) report high sensitivity and specificity for identifying Black beneficiaries with both Medicare race variables. They report low Hispanic sensitivity for the EDB variable (36.2), but good sensitivity for the RTI variable (90.8); sensitivity for Asian/Pacific Islander beneficiaries is 62.6 and 74.7, respectively. The claim omits these differences between the data files, particularly for Hispanic beneficiaries. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 24

  1. [1]Perez-Stable EJ, Collins FS. Science visioning in minority health and health disparities. Am J Pub Health 2019; 109: S5. 30699033 PMC6356132
  2. [3]Jeffries N, Zaslavsky AM, Diez Roux AV, Methodological approaches to understanding causes of health disparities. Am J Pub Health 2019; 109: S28– S33. 30699015 PMC6356121
  3. [4]Duran DG, Perez-Stable EJ. Science visioning to advance the next generation of health disparities research. Am J Pub Health 2019; 109: S11– S3. 30699020 PMC6356136
  4. [5]Bilheimer LT, Sisk JE. Collecting adequate data on racial and ethnic disparities in health: The challenges continue. Health Affairs 2008; 27: 383– 91. 18332493
  5. [6]Ng JH, Ye F, Ward LM, Haffer SC, Scholle SH. Data on race, ethnicity, and language largely incomplete for managed care plan members. Health Aff (Millwood) 2017; 36: 548– 52. 28264958
  6. [7]Executive Office of the President Office of Management and Budget, Office of Information and Regulatory Affairs. Revisions to the standards for the classification of federal data on race and ethnicity. Washington, DC: Federal Register; 1997: 58782– 90.
  7. [9]Joynt Maddox KE, Chen LM, Zuckerman R, Epstein AM. Association between race, neighborhood, and Medicaid enrollment and outcomes in Medicare home health care. J Am Geriatr Soc 2018; 66: 239– 46. 28975604
  8. [10]Belanger E, Silver B, Meyers DJ, A retrospective study of administrative data to identify high-need Medicare beneficiaries at risk of dying and being hospitalized. J Gen Intern Med 2019. PMC6420563 30604120
  9. [11]Bierman AS, Lurie N, Collins KS, Eisenberg JM. Addressing racial and ethnic barriers to effective health care: The need for better data. Health Affairs 2002; 21: 91– 102. 12026007
  10. [12]Thomson GE, Mitchell, Willimams MB, eds. Examining the Health Disparities Research Plan of the National Institutes of Health: Unfinished Business. Washington, DC: National Academies Press; 2006. 21850786
  11. [13]Race, Ethnicity, and Language Data: Standardization for Health Care Quality Improvement. Washington, DC: The National Academies Press; 2009. 25032349
  12. [14]National Research Council. Eliminating Health Disparities: Measurement and Data Needs. Washington, DC: The National Academies Press; 2004 Pages 68– 72. 10.17226/10979. 25009872 · DOI
  13. [15]Filice CE, Joynt KE. Examining race and ethnicity information in Medicare administrative data. Med Care 2017; 55: e170– e6. 29135782
  14. [16]Li Y, Cai X, Glance LG. Disparities in 30-day rehospitalization rates among Medicare skilled nursing facility residents by race and site of care. Med Care 2015; 53: 1058– 65. 26492217 PMC4648673
  15. [17]Eicheldinger C, Bonito A. More accurate racial and ethnic codes for Medicare administrative data. Health Care Financ Rev 2008; 29: 27– 42. 18567241 PMC4195038
  16. [19]Lim E, Gandhi K, Davis J, Chen JJ. Prevalence of chronic conditions and multimorbidities in a geographically defined geriatric population with diverse races and ethnicities. J Aging Health 2018; 30: 421– 44. 27913765 PMC5634944
  17. [21]O’Connor M, Davitt JK. The Outcome and Assessment Information Set (OASIS): a review of validity and reliability. Home Health Care Serv Q 2012; 31: 267– 301. 23216513 PMC4529994
  18. [22]Cohen J A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20: 37– 46.
  19. [24]Waldo DR. Accuracy and bias of race/ethnicity codes in the Medicare Enrollment Database. Health Care Financing Review 2004; 26: 61– 72. 25371985 PMC4194866
  20. [25]Zaslavsky AM, Ayanian JZ, Zaborski LB. The validity of race and ethnicity in enrollment data for Medicare beneficiaries. Health Serv Res 2012; 47: 1300– 21. 22515953 PMC3349013
  21. [26]Haas A, Elliott MN, Dembosky JW, Imputation of race/ethnicity to enable measurement of HEDIS performance by race/ethnicity. Health Serv Res 2019; 54: 13– 30506674 PMC6338295
  22. [27]Dembosky JW, Haviland AM, Haas A, Indirect estimation of race/ethnicity for survey respondents who do not report race/ethnicity. Medical Care 2018. 30520838
  23. [28]Bykov K, Franklin JM, Toscano M, Evaluating cardiovascular health disparities using estimated race/ethnicity: A validation study. Med Care 2015; 53: 1050– 7. 26565524
  24. [29]Klein DJ, Elliott MN, Haviland AM, A comparison of methods for classifying and modeling respondents who endorse multiple racial/ethnic categories. Med Care 2019; 57(6): e-34– e41. 30439794

Cited by

Sorted by citations

Authors
Jarrín, O. F., Nyandege, A. N., Grafova, I. B., Dong, X., & Lin, H.
Affiliations
  • Division of Nursing Science, School of Nursing
  • Institute for Health, Health Care Policy, and Aging Research
  • Rutgers, The State University of New Jersey (US)
Corresponding author
Lin, Haiqun
Venue
Medical Care
Published
2019-10-29
Volume
58
Issue
1
Pages
e1-e8
ISSN
0025-7079 (ISSN-L)
OpenAlex
W2986214232
Cited by
347
References
2
Citations by year
2026: 30 · 2025: 66 · 2024: 62 · 2023: 75 · 2022: 70 · 2021: 37 · 2020: 6 · 2019: 1
FWCI
31.11
Type
journal article
Language
en
Open access
Locations
  • Medical Care (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
  • Rutgers University Community Repository (Rutgers University) (submittedVersion)
Funders
  • Agency for Healthcare Research and Quality (R00 HS022406)
  • National Institute of Nursing Research (R01NR014855)
Topics
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Race, Genetics, and Society
  • Social Sciences › Health › Health disparities and outcomes
Keywords
self-reported race, home health care, OASIS, health disparities research, Black race, data validity
MeSH terms
Aged, Aged, 80 and over, Ethnicity, Female, Medicare, Home Care Services, Humans, Male, Predictive Value of Tests, Sensitivity and Specificity, United States, Reproducibility of Results, Outcome Assessment, Health Care, Racial Groups, Health Status Disparities, Healthcare Disparities, Self Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review