Facilitating research on racial and ethnic disparities and inequities in transportation: Application and evaluation of the Bayesian Improved Surname Geocoding (BISG) algorithm
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Racial and ethnic disparities and/or inequities have been documented in traffic safety research. However, race/ethnicity data are often not captured in population-level traffic safety databases, limiting the field's ability to comprehensively study racial/ethnic differences in transportation outcomes, as well as our ability to mitigate them. To overcome this limitation, we explored the utility of estimating race and ethnicity for drivers in the New Jersey Safety and Health Outcomes (NJ-SHO) data warehouse using the Bayesian Improved Surname Geocoding (BISG) algorithm. In addition, we summarize important recommendations established to guide researchers developing and implementing racial and ethnic disparity research. METHODS: We applied BISG to estimate population-level race/ethnicity for New Jersey drivers in 2017 and evaluated the concordance between reported values available in integrated administrative sources (e.g., hospital records) and BISG probability distributions using an area under the receiver operator curve (AUC) within each race/ethnicity category. Overall AUC was calculated by weighting each AUC value by the population count in each reported category. In an exemplar analysis using 2017 crash data, we conducted an analysis of average monthly police-reported crash rates in 2017 by race/ethnicity using the NJ-SHO and BISG sets of race/ethnicity values to compare their outputs. RESULTS: We found excellent or outstanding concordance (AUC ≥0.86) between reported race/ethnicity and BISG probabilities for White, Hispanic, Black, and Asian/Pacific Islander drivers. We found poor concordance for American Indian/Alaskan Native drivers (AUC= 0.65), and concordance was no better than random assignment for Multiracial drivers (AUC = 0.52). Among White, Hispanic, Asian/Pacific Islander, and American Indian/Alaskan native drivers, monthly crash rates calculated using both NJ-SHO reported race/ethnicity values and BISG probabilities were similar. Monthly crash rates differed by 11% for Black drivers, and by more than 200% for Multiracial drivers. CONCLUSION: Findings of excellent or outstanding concordance between and mostly similar crash rates derived from reported race/ethnicity and BISG probabilities for White, Hispanic, Black, and Asian/Pacific Islander drivers (98.9% of all drivers in this sample) demonstrate the potential utility of BISG in enabling research on transportation disparities and inequities. Concordance between race/ethnicity values were not acceptable for American Indian/Alaskan Native and Multiracial drivers, which is similar to previous applications and evaluations of BISG. Future work is needed to determine the extent to which BISG may be applied to traffic safety contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Predictive accuracy using BIFSG is poorer for American Indian/Alaska Natives (Sartin et al. 2021)”
From Profiling consumers who reported mass marketing scams: demographic characteristics and emotional sentiments associated with victimization (2024) · cites this paper as Sartin et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861 · cited 1×
“Finally, to conduct an initial evaluation of this approach, we determined the concordance between reported race/ethnicity value and BISG probabilities using area under the receiver operator curve (AUC) within each race/ethnicity category (Elliott et al. 2009; Hosmer et al. 2013).”
MethodTraveling Towards Disease: Transportation Barriers to Health Care Access
Syed, S. T., Gerber, B. S., & Sharp, L. K. (2013) · Journal of Community Health · doi:10.1007/s10900-013-9681-1 · Cited by 1,987 · cited 1×
“Further, racial and ethnic minority populations report facing more barriers to transportation, which interfere with employment, housing, health, and well-being (Sanchez et al. 2004; Flores and Tomany-Korman 2008; Syed et al. 2013; Blumenberg and Pierce 2014).”
BackgroundUse of race and ethnicity in biomedical publication
Kaplan, J. B. (2003) · JAMA · doi:10.1001/jama.289.20.2709 · Cited by 609
Arias, E., Schauman, W. S., Eschbach, K., Sorlie, P. D., & Backlund, E. (2008) · PubMed · Cited by 546
Flores, G., & Tomany-Korman, S. C. (2008) · Pediatrics · doi:10.1542/peds.2007-1243 · Cited by 492
The Reporting of Race and Ethnicity in Medical and Science Journals: Comments Invited
Flanagin, A., Frey, T., Christiansen, S. L., & Bauchner, H. (2021) · JAMA · doi:10.1001/jama.2021.2104 · Cited by 303
Accuracy of Race, Ethnicity, and Language Preference in an Electronic Health Record
Klinger, E. V., Carlini, S. V., Gonzalez, I., Hubert, S. S., Linder, J. A., Rigotti, N. A., Kontos, E. Z., Park, E. R., Marinacci, L. X., & Haas, J. S. (2015) · Journal of General Internal Medicine · doi:10.1007/s11606-014-3102-8 · Cited by 234
Elliott, M. N., Morrison, P. A., Fremont, A., McCaffrey, D. F., Pantoja, P., & Lurie, N. (2009) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-009-0047-1 · Cited by 224
Elliott, M. N., Fremont, A., Morrison, P. A., Pantoja, P., & Lurie, N. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00854.x · Cited by 206 · cited 1×
“The BISG algorithm was developed by the RAND Corporation for use in health disparity research as an approach to produce accurate and reliable group- or population-level race/ethnicity estimates (Elliott et al. 2008, 2009; Adjaye-Gbewonyo et al. 2014).”
MethodBlumenberg, E., & Pierce, G. (2014) · Journal of the American Planning Association · doi:10.1080/01944363.2014.935267 · Cited by 111 · cited 1×
“Further, racial and ethnic minority populations report facing more barriers to transportation, which interfere with employment, housing, health, and well-being (Sanchez et al. 2004; Flores and Tomany-Korman 2008; Syed et al. 2013; Blumenberg and Pierce 2014).”
Background
Cited by
Zhu, C., Brown, C. T., Dadashova, B., Ye, X., Sohrabi, S., & Potts, I. B. (2023) · Accident Analysis & Prevention · doi:10.1016/j.aap.2023.106964 · Cited by 38
Methods for retrospectively improving race/ethnicity data quality: a scoping review
Chin, M. K., Ðoàn, L. N., Russo, R. G., Roberts, T., Persaud, S., Huang, E., Fu, L., Kui, K. Y., Kwon, S. C., & Yi, S. S. (2023) · Epidemiologic Reviews · doi:10.1093/epirev/mxad002 · Cited by 23
Fairness Without Demographic Data: A Survey of Approaches
Ashurst, C., & Weller, A. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623234 · Cited by 21
“For example, methods to infer race/ethnicity based on surname and geolocation have been proposed to assess disparities in domains such as health care, transportation and finance [44, 120, 150], and commercial products that predict gender and ethnicity based on names are available [96].”
MethodDeLiema, M., & Witt, P. (2024) · Security Journal · doi:10.1057/s41284-023-00401-5 · Cited by 20
“Predictive accuracy using BIFSG is poorer for American Indian/Alaska Natives (Sartin et al. 2021) and for multiracial individuals (Derose et al. 2013).”
Disaggregating Racial and Ethnic Data: A Step Toward Diversity, Equity, and Inclusion
Liang, P. S., Kwon, S. C., Cho, I., Trinh‐Shevrin, C., & Yi, S. S. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2022.12.001 · Cited by 20
Metadata
- Authors
- Sartin, E. B., Metzger, K. B., Pfeiffer, M. R., Myers, R. K., & Curry, A. E.
- Affiliations
- Children's Hospital of Philadelphia (US)
- Corresponding author
- Sartin, Emma B.
- Venue
- Traffic Injury Prevention
- Publisher
- Informa UK Limited
- Published
- 2021-08-17
- Volume
- 22
- Issue
- sup1
- Pages
- S32-S37
- ISSN
- 1538-957X (ISSN-L)
- 1538-9588
- PMC
- PMC8792156
- OpenAlex
- W3195228402
- Cited by
- 14
- References
- 24
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 7 · 2022: 1
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Traffic Injury Prevention (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Child Health and Human Development (R21HD098276, R21HD092850)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development
- Topics
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Traffic and Road Safety
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- road safety, Black drivers
- MeSH terms
- Accidents, Traffic, Algorithms, Bayes Theorem, Ethnicity, Humans, United States, Geographic Mapping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Facilitating research on racial and ethnic disparities and inequities in transportation: Application and evaluation of the Bayesian Improved Surname Geocoding (BISG) algorithm. https://app.cochat.ai/papers/10.1080/15389588.2021.1955109
- The paper
- Sartin, E. B., Metzger, K. B., Pfeiffer, M. R., Myers, R. K., & Curry, A. E. (2021). Facilitating research on racial and ethnic disparities and inequities in transportation: Application and evaluation of the Bayesian Improved Surname Geocoding (BISG) algorithm. Traffic Injury Prevention. https://doi.org/10.1080/15389588.2021.1955109
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.