“We adjusted for race”: now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology, 2020–2021
Open accessThe DOI matches its Crossref record; 220 of the 221 references it cites were found in a registry or an index; 9 of the 39 sources its claims cite were checked for support.
Abstract
Race is a social construct, commonly used in epidemiologic research to adjust for confounding. However, adjustment of race may mask racial disparities, thereby perpetuating structural racism. We conducted a systematic review of articles published in Epidemiology and American Journal of Epidemiology between 2020 and 2021 to (1) understand how race, ethnicity, and similar social constructs were operationalized, used, and reported; and (2) characterize good and poor practices of utilization and reporting of race data on the basis of the extent to which they reveal or mask systemic racism. Original research articles were considered for full review and data extraction if race data were used in the study analysis. We extracted how race was categorized, used—as a descriptor, confounder, or for effect measure modification (EMM)—and reported if the authors discussed racial disparities and systemic bias–related mechanisms responsible for perpetuating the disparities. Of the 561 articles, 299 had race data available and 192 (34.2%) used race data in analyses. Among the 160 US-based studies, 81 different racial categorizations were used. Race was most often used as a confounder (52%), followed by effect measure modifier (33%), and descriptive variable (12%). Fewer than 1 in 4 articles (22.9%) exhibited good practices (EMM along with discussing disparities and mechanisms), 63.5% of the articles exhibited poor practices (confounding only or not discussing mechanisms), and 13.5% were considered neither poor nor good practices. We discuss implications and provide 13 recommendations for operationalization, utilization, and reporting of race in epidemiologic and public health research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 3 Not valid · 19 Not checked · 46 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“For example, 1 study combined Black, Hispanic, Asian, and Native American groups into a “Non-White or Hispanic” category and found no association between the exposure and the outcome.53”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Discussion
What the sources say
- Supportedcites [53] Austin AE, Naumann RB, Short NA. Association between Medicaid expansion and suicide mortality among nonelderly US adults. Am J Epidemiol. 2021;190(9):1760-1769. https://doi. org/10.1093/aje/kwab130. source
Our copy's Methods (Statistical analysis) states the race/ethnicity subgroup analyses were conducted as "non-Hispanic White vs. non-White or Hispanic," i.e. a residual composite category, and the Results (p. Results) report that Medicaid expansion "was not associated with a substantial change in the suicide rate among ... non-White or Hispanic individuals (β = 0.1, 95% CI: −1.0, 1.3)", echoed in the Abstract and the Discussion ("it was not associated with a change in the suicide rate among non-White or Hispanic individuals"). The exposure (Medicaid expansion, METHODS > Exposure) and outcome (suicide rate per 100,000) match the claim's "exposure and the outcome". Our copy names the composite label and illustrates it with non-Hispanic Black and Hispanic adults in the Discussion, but does not itemize every constituent group (Asian, American Indian/Alaska Native), which follows from the residual definition rather than being spelled out. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A more recent study that examined samples of articles from 4 journals found similar results.15”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Discussion
What the sources say
- Partly supportedcites [15] Martinez RAM, Andrabi N, Goodwin AN, et al. Conceptualiza- tion, operationalization, and utilization of race and ethnicity in major epidemiology journals 1995-2018: a systematic review. Am J Epidemiol. 2023;192(3):483-496. https://doi.org/10.1093/ aje/kwac146. sourceExperimental — accuracy not yet measured
The Methods (Study design; page unavailable) confirm that the study reviewed sampled articles, and the Abstract reports that practices remained largely unchanged over time. The journal count is incorrect: the Methods name five journals, not four. The citing sentence does not specify which earlier results it considers similar. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A third study used racial disparities in the ratio of forced expiratory volume in 1 second to forced vital capacity as a biological “normal” to determine a patient’s eligibility for additional testing and to be classified as having chronic obstructive pulmonary disease.186”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Discussion
What the sources say
- Partly supportedcites [186] Feinstein, 2020, Validation of questionnaire-based case definitions for chronic obstructive pulmonary disease, Epidemiology. sourceExperimental — accuracy not yet measured
The Methods section, “Ascertainment of ‘True’ COPD Status” (page unavailable), says that an age-, sex-, and race/ethnicity-specific lower limit of normal for FEV1/FVC was one criterion for additional spirometry and COPD classification. It also allowed fixed-ratio cutoffs; it does not describe racial differences as a biological “normal” or say race-specific limits were required in every case. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only approximately 1 in 4 studies that collapsed racial categories provided a reason for doing so, which included inclusion and exclusion criteria or small sample sizes.”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Those that did used more than 81 different categorizations (Table 4; Web Table 2), including categorizations in which racialized groups were collapsed into a larger category commonly termed “other.””
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Operationalization of race
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
23 more claims
Create a free account to see all 74 claims and to verify the 30 references still open.
- It may state two separate claims as one. 29
- Probably not a substantial claim. 29
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Study design and search
“We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for reporting this systematic review.22”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > References
“22. Warren E. S.4533 -116th Congress (2019-2020): Anti-Racism in Public Health Act of 2020.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Nine articles (14.3%) that only used race as a descriptor or confounder discussed disparities in the outcome by race and the systemic racism-related mechanisms that may have led to the disparities.”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Utilization of race and reporting practices
Reported 14.3 · recomputed 4.6875
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Abstract
“Fewer than 1 in 4 articles (22.9%) exhibited good practices (EMM along with discussing disparities and mechanisms)”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Utilization of race and reporting practices
“presented descriptive data and discussed disparities and mechanisms (n = 3; 1.6%)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“4 (1.3%) that did not clarify how race was used”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > Utilization of race and reporting practices
Reported 1.3 · recomputed 2.083333
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Excluded (n = 396) Did not include keywords”
§ Review "We adjusted for race": now what? A systematic review of utilization and reporting of race in American Journal of Epidemiology and Epidemiology > All Assessed Articles (N = 894)
Reported 192 · recomputed 165
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003583 · Cited by 5,148
Genetic Structure of Human Populations
Rosenberg, N. A., Pritchard, J. K., Weber, J. L., Cann, H. M., Kidd, K. K., Zhivotovsky, L. A., & Feldman, M. W. (2002) · Science · doi:10.1126/science.1078311 · Cited by 2,222
Updated Guidance on the Reporting of Race and Ethnicity in Medical and Science Journals
Flanagin, A., Frey, T., Christiansen, S. L., & AMA Manual of Style Committee (2021) · JAMA · doi:10.1001/jama.2021.13304 · Cited by 1,615
Recommendations for presenting analyses of effect modification and interaction
Knol, M. J., & VanderWeele, T. J. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dyr218 · Cited by 1,494
The public health critical race methodology: praxis for antiracism research.
Ford, C. L., & Airhihenbuwa, C. O. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.07.030 · Cited by 757
Invited commentary: “Race, racism, and the practice of epidemiology”
Jones, C. P. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.4.299 · Cited by 532
Measuring structural racism: a guide for epidemiologists and other health researchers
Adkins-Jackson, P. B., Chantarat, T., Bailey, Z. D., & Ponce, N. A. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwab239 · Cited by 417
Commentary: Considerations for Use of Racial/Ethnic Classification in Etiologic Research
Kaufman, J. S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.4.291 · Cited by 405
Why genes don't count (for racial differences in health)
(2000) · American Journal of Public Health · doi:10.2105/ajph.90.11.1699 · Cited by 325
Refiguring “Race”: Epidemiology, Racialized Biology, and Biological Expressions of Race Relations
Krieger, N. (2000) · International Journal of Health Services · doi:10.2190/672j-1ppf-k6qt-9n7u · Cited by 239
Research works printed but not linked: 1
- Rothman KJ, Greenland S, Lash TL, eds. In: Modern Epidemiology. 3rd ed. Lippincott Williams & Wilkins; 2008.
Cited by
Items 101–124 of 124
Bullying, State Policy, and Mental Health Symptoms in Gender-Diverse Youths
Hughes, D., Zapetis, S. L., Mordy, A. E., López, D., Calderon, V., Adery, L. H., Martino, R. M., Chang, S. E., Uddin, L. Q., Cardenas‐Iniguez, C., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.8104 · Cited by 1
Tortolero, G. A., Sturgis, E. M., Yamal, J., Peskin, M. F., Bauer, C., & Murphy, C. C. (2026) · Cancer Epidemiology · doi:10.1016/j.canep.2026.103086
Cha, L., Moorehead, D., McLaughlin, K. A., & Sumner, J. A. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119336 · Cited by 1
Association between preeclampsia and eclampsia in Black women with endometriosis: a scoping review
Alaribe, C. C., & Sapre, K. D. (2026) · BMC Public Health · doi:10.1186/s12889-026-27739-w
Sampson, L., Bonauto, D. K., & Marcum, J. L. (2026) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph23060699
Tassiopoulos, K. N., Primeau, C. A., Bui, E., & Johnson, E. (2026) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2026.111132
Dey, A., Chen, C., Do, V., Zhou, S. (., González, R., & Benmarhnia, T. (2026) · Environmental Epidemiology · doi:10.1097/ee9.0000000000000485
“…confounder regards potential differential vulnerability leading to such disparities (e.g., systematic racism manifested through air pollution) as irrelevant to the research question through a “ritualistic adjustment,” 28–30 and precludes consideration of differential vulnerability across RE groups.”
Diaz, L. M., Thakur, N., Lewis, S. C., Ye, M., González, D. J. X., Bush, N. R., Long, D., Hessler, D., & de la Rosa, R. (2026) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2026.107936
Racial Disparities in Patient-Reported Baby-Friendly Breastfeeding Support
Standish, K. R., Semenya, A. M., Ferguson, S., Soma, S.-E., Kambhampati, R., Artuk, D., Yeghiayan, S., Lee, A. C. C., & Parker, M. G. K. (2026) · Hospital Pediatrics · doi:10.1542/hpeds.2025-008928
Tortolero, G. A., Sturgis, E. M., Sokale, I. O., Oluyomi, A. O., Dahlstrom, K. R., & Thrift, A. P. (2026) · Cancer Causes & Control · doi:10.1007/s10552-026-02209-1
“The primary strength of this research was the assessment of multiple social factors to understand the underlying drivers of racial and ethnic disparities in OCC stage at diagnosis [10, 11, 29, 30, 43–45].”
Moyo, P., George, M., Hughes, L. D., Shireman, T. I., Donohue, J. M., Andrews, C. M., Peterson, L., & Hughto, J. M. W. (2026) · Medical Care · doi:10.1097/mlr.0000000000002366
“44 Therefore, our findings on race/ethnicity reflect broader structural inequities and unmeasured socioeconomic factors rather than biological differences.”
Spaur, M., Schilling, K., Glabonjat, R. A., Basu, A., Patterson, K. P., Lieberman‐Cribbin, W., Chen, Q., Ravalli, F., Gálvez-Fernández, M., Factor-Litvak, P. R., et al. (2026) · Environmental Research · doi:10.1016/j.envres.2026.125295
Riley, T., Hassan, A., Khattar, A., & Benson, L. S. (2026) · Health Equity · doi:10.1177/24731242261472700
Barry, K. R., Chaku, N., & Hoyt, L. T. (2026) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-026-01493-4
“Future studies with larger samples could better detect small effects and explore sex, as well as gender, dif - ferences and potential moderating effects of race/ethnicity, given established differences in pubertal timing for racial/ ethnically diverse youth (Swilley-Martinez et al., 2023 ).”
Zubizarreta, D., Beccia, A. L., Chen, J. T., Coull, B. A., & Austin, S. B. (2026) · Sleep Health · doi:10.1016/j.sleh.2026.07.014
Neighborhood Economic Deprivation, Hispanic Ethnic Enclaves, and Congenital Anomalies in Texas
Schraw, J. M., Rathod, R. A., Hughes, A. E., Pruitt, S. L., Kirby, R. S., Shaw, G. M., & Lupo, P. J. (2026) · Birth Defects Research · doi:10.1002/bdr2.70114
Trade-Offs Between Patient Experience and Health Care Access
Wong, M. S., Steers, W. N., Lind, K. E., & Washington, D. L. (2026) · Medical Care · doi:10.1097/mlr.0000000000002368
Prevalence and Characteristics of Mental Health Interventions Following Pediatric Hospitalization
DeSerisy, M., Heneghan, J. A., Hall, M., Choi, D. H., Dervan, L. A., Garros, D., Goodman, D. M., Kane, J. M., Kohne, J. G., Rogerson, C. M., et al. (2026) · Hospital Pediatrics · doi:10.1542/hpeds.2026-009345
Bashi, A., Schuch, V., Dawning, A., Joseph, T. T., Baltrus, P., Moore, C. J., & Johnson, E. L. (2026) · Nutrients · doi:10.3390/nu18182965
Hughes, C., Rimal, R. N., Feder, K. A., & Underwood, C. (2026) · Obesity Science & Practice · doi:10.1002/osp4.70198
“To preserve the distinct identities of the underlying groups [81], relevant tables list the distinct racial/ethnic categories within the collapsed group.”
Comess, S., Warren, J. L., Shaw, G. M., & Ho, D. E. (2026) · Epidemiology · doi:10.1097/ede.0000000000002046
Halvorson-Fried, S. M., SERRANO, N. H., Jensen, T. M., Taillie, L. S., Hall, M. G., Golden, S. D., & Ribisl, K. M. (2026) · Health & Place · doi:10.1016/j.healthplace.2026.103749
Individual-level Structural Neuroimaging Biomarkers across the Psychosis SpectrumPreprint
Rivas, A. M., Sari, E., Demirlek, C., Demirlek, C., Stein, A., Loshin, J., Chouinard, V., Halko, M. A., Brady, R. O., Lewandowski, K. E., et al. (2026) · medRxiv · doi:10.64898/2026.10.18.26365847
WATER EPI Lab Drinking Water Repository
Rajeev, T., Chen, Y., Bloomquist, T., & Nigra, A. E. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.20443825
Metadata
- Authors
- Swilley-Martinez, M. E., Coles, S. A., Miller, V. E., Alam, I. Z., Fitch, K. V., Cruz, T. H., Hohl, B., Murray, R., & Ranapurwala, S. I.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- University of New Mexico (US)
- University of Pennsylvania (US)
- University of Arkansas at Fayetteville (US)
- Corresponding author
- Ranapurwala, Shabbar I
- ORCID
- Venue
- Epidemiologic Reviews
- Publisher
- Oxford University Press (OUP)
- Published
- 2023
- Volume
- 45
- Issue
- 1
- Pages
- 15-31
- ISSN
- 0193-936X (ISSN-L)
- 1478-6729
- PMC
- PMC12098948
- OpenAlex
- W4387327129
- Semantic Scholar
- 621183a009f209e3d253729983458bb38e7d3d0c
- Cited by
- 123
- References
- 221
- Citations by year
- 2026: 41 · 2025: 55 · 2024: 27
- FWCI
- 4.76
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Epidemiologic Reviews (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UNM’s Digital Repository (University of New Mexico) (submittedVersion)
- Funders
- National Institute of Mental Health (R01MH124752-02S1, R01MH124752)
- Centers for Disease Control and Prevention (R01CE003009)
- NIH
- Topics
- Social Sciences › Anthropology › Race, Genetics, and Society
- Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- race, racial disparities, structural racism, confounding adjustment, effect modification, racial classification, social determinants of health, epidemiology journals, racial bias in research
- MeSH terms
- Systemic Racism, Data Collection, Ethnicity, Humans, Public Health, United States, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.