Using the Bayesian Improved Surname Geocoding Method (BISG) to Create a Working Classification of Race and Ethnicity in a Diverse Managed Care Population: A Validation Study
Open accessAbstract
Objective: To validate classification of race/ethnicity based on the Bayesian Improved Surname Geocoding method (BISG) and assess variations in validity by gender and age. Data Sources/Study Setting: Secondary data on members of K aiser P ermanente G eorgia, an integrated managed care organization, through 2010. Study Design: For 191,494 members with self‐reported race/ethnicity, probabilities for belonging to each of six race/ethnicity categories predicted from the BISG algorithm were used to assign individuals to a race/ethnicity category over a range of cutoffs greater than a probability of 0.50. Overall as well as gender‐ and age‐stratified sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated. Receiver operating characteristic (ROC) curves were generated and used to identify optimal cutoffs for race/ethnicity assignment. Principal Findings: The overall cutoffs for assignment that optimized sensitivity and specificity ranged from 0.50 to 0.57 for the four main racial/ethnic categories (White, Black, Asian/Pacific Islander, Hispanic). Corresponding sensitivity, specificity, PPV, and NPV ranged from 64.4 to 81.4 percent, 80.8 to 99.7 percent, 75.0 to 91.6 percent, and 79.4 to 98.0 percent, respectively. Accuracy of assignment was better among males and individuals of 65 years or older. Conclusions: BISG may be useful for classifying race/ethnicity of health plan members when needed for health care studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Understanding diagnostic tests 3: receiver operating characteristic curves
Akobeng, A. K. (2007) · Acta Paediatrica · doi:10.1111/j.1651-2227.2006.00178.x · Cited by 1,882 · see citing works
Race, Ethnicity, and Language Data: Standardization for Health Care Quality Improvement
Ulmer, C. C., McFadden, B., & Nerenz, D. R. (2009) · University Libraries (University of Maryland) · doi:10.13016/jjuy-tsdb · Cited by 320 · see citing works
Use of geocoding and surname analysis to estimate race and ethnicity.
Fiscella, K., & Fremont, A. M. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00551.x · Cited by 272 · see citing works
Shah, B. R., Chiu, M., Amin, S., et al. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-42 · Cited by 224 · see citing works
Elliott, M. N., Morrison, P. A., Fremont, A., McCaffrey, D. F., Pantoja, P., & Lurie, N. (2009) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-009-0047-1 · Cited by 224 · see citing works
Elliott, M., Fremont, A. M., Morrison, P., Pantoja, P. M., & Lurie, N. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00854.x · Cited by 216 · see citing works
A COMPARISON OF THREE INDICATORS FOR IDENTIFYING MEXICAN AMERICANS IN EPIDEMIOLOGIC RESEARCH
Hazuda, H. P., Comeaux, P. J., D, M. P. S. M., Haffner, S. M., Eifler, C. W., & Rosenthal, M. (1986) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114228 · Cited by 182 · see citing works
Development and Validation of a Surname List to Define Chinese Ethnicity
Quan, H., Wang, F., Schopflocher, D., Norris, C. M., Galbraith, P. D., Faris, P., Graham, M. M., Knudtson, M. L., & Ghali, W. A. (2006) · Medical Care · doi:10.1097/01.mlr.0000204010.81331.a9 · Cited by 111 · see citing works
Elliott, M. N., Morrison, P. A., Fremont, A. M., McCaffrey, D. F., Pantoja, P. M., & Lurie, N. (2009) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-009-0055-1 · Cited by 95 · see citing works
SURVEY RESEARCH NEW MEXICO HISPANICS: SOME METHODOLOGICAL ISSUES
Howard, C. A., Samet, J. M., Buechley, R. W., et al. (1983) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113512 · Cited by 92 · see citing works
Analyzing Receiver Operating Characteristic Curves With SAS
Hall, D. B. (2008) · The American Statistician · doi:10.1198/tas.2008.s272 · Cited by 92 · see citing works
Lakha, F., Gorman, D., & Mateos, P. (2011) · Public Health · doi:10.1016/j.puhe.2011.05.003 · Cited by 85 · see citing works
Wei, I. I., Virnig, B. A., John, D. A., & Morgan, R. O. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00550.x · Cited by 78 · see citing works
Using Name Lists to Infer Asian Racial/Ethnic Subgroups in the Healthcare Setting
Wong, E. C., Palaniappan, L. P., & Lauderdale, D. S. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181d559e9 · Cited by 58 · see citing works
Advancing Health Care Equity through Improved Data Collection
Weissman, J. S., & Hasnain‐Wynia, R. (2011) · New England Journal of Medicine · doi:10.1056/nejmp1103069 · Cited by 35 · see citing works
Escarce, J. J., Carreón, R., Veselovskiy, G., et al. (2011) · Health Affairs · doi:10.1377/hlthaff.2010.1117 · Cited by 16 · see citing works
Exploring health plan perspectives in collecting and using data on race, ethnicity, and language.
Gazmararian, J., Carreón, R., Olson, N., et al. (2012) · PubMed · Cited by 7 · see citing works
Improving the Imputation of Race: Evaluating the Benefits of Stratifying by Age
Sandberg, T. J., Wilson, A. R., Rodin, H., Garrett, N. A., Bargman, E. P., Dobmeyer, D. J., & Plocher, D. W. (2009) · Population Health Management · doi:10.1089/pop.2009.0006 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Davis, A. C., Voelkel, J. L., Remmers, C. L., Adams, J. L., & McGlynn, E. A. (2023) · The Permanente Journal · doi:10.7812/tpp/22.172 · Cited by 402 · see citing works
Labgold, K., Hamid, S., Shah, S., Gandhi, N. R., Chamberlain, A., Khan, F., Khan, S., Smith, S., Williams, S., Lash, T. L., et al. (2021) · Epidemiology · doi:10.1097/ede.0000000000001314 · Cited by 89 · see citing works
Assessing Fair Lending Risks Using Race/Ethnicity Proxies
Zhang, Y. (2018) · Management Science · doi:10.1287/mnsc.2016.2579 · Cited by 71 · see citing works
DeLiema, M., & Witt, P. (2024) · Security Journal · doi:10.1057/s41284-023-00401-5 · Cited by 20 · see citing works
Sartin, E. B., Metzger, K. B., Pfeiffer, M. R., Myers, R. K., & Curry, A. E. (2021) · Traffic Injury Prevention · doi:10.1080/15389588.2021.1955109 · Cited by 14 · see citing works
- Authors
- Adjaye‐Gbewonyo, D., Bednarczyk, R. A., Davis, R. L., & Omer, S. B.
- Affiliations
- Kaiser Permanente (US)
- Corresponding author
- Adjaye‐Gbewonyo, Dzifa
- Venue
- Health Services Research
- Publisher
- Wiley
- Published
- 2013-07-16
- Volume
- 49
- Issue
- 1
- Pages
- 268-283
- ISSN
- 0017-9124 (ISSN-L)
- 1475-6773
- PMC
- PMC3922477
- OpenAlex
- W2025824923
- Cited by
- 63
- References
- 18
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 8 · 2023: 10 · 2022: 8 · 2021: 3 · 2020: 4 · 2019: 2 · 2018: 6 · 2017: 2 · 2016: 3 · 2015: 5
- FWCI
- 4.62
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Health Services Research (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Kaiser Permanente
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Race, Genetics, and Society
- Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
- Keywords
- racial and ethnic classification, classification validity, sensitivity and specificity, positive predictive value, negative predictive value, gender differences, age differences
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Algorithms, Bayes Theorem, Birth Certificates, Child, Child, Preschool, Female, Health Services Research, Humans, Infant, Infant, Newborn, Male, Managed Care Programs, Middle Aged, Names, Sensitivity and Specificity, United States, Racial Groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
