Double-Checking the Race Box: Examining Inconsistency between Survey Measures of Observed and Self-Reported Race
Abstract
Social constructivist theories of race suggest no two measures of race will capture the same information, but the degree of “error” this creates for quantitative research on inequality is unclear. Using unique data from the General Social Survey, I find observed and self-reported measures of race yield substantively different results when used to explain income inequality in the United States. This occurs because inconsistent racial classification is correlated with other respondent characteristics such as immigrant generation, educational attainment and age.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These mismatches can significantly impact health statistics, population statistics, and measures of social inequality.
“This in turn can significantly impact health statistics [62, 101], population statistics [8, 74], and measures of social inequality [102].”
From Towards a critical race methodology in algorithmic fairness (2020) · cites this paper as [102]
Racial category and measurement choices can affect outcomes being measured in survey research.
“a growing body of survey research has highlighted the impact that racial category and measurement choices can have on outcomes being measured [102-104].”
From Towards a critical race methodology in algorithmic fairness (2020) · cites this paper as [102]
When race is utilized as a descriptive category, the choices about what categories to use and how to assign individuals to categories significantly impacts the results of analysis.
“When race is utilized as a descriptive category, the choices about what categories to use and how to assign individuals to categories significantly impacts the results of analysis [18, 102, 114, 115].”
From Towards a critical race methodology in algorithmic fairness (2020) · cites this paper as [102]
Cites
(1994) · Cited by 6,200 · see citing works
Whiteness of a Different Color
Jacobson, M. F. (1999) · Harvard University Press eBooks · doi:10.2307/j.ctvjk2w15 · Cited by 1,761 · see citing works
Ethnic options: choosing identities in America
(1991) · Choice Reviews Online · doi:10.5860/choice.28-3591 · Cited by 1,420 · see citing works
White by law: the legal construction of race
(1996) · Choice Reviews Online · doi:10.5860/choice.34-1213 · Cited by 1,326 · see citing works
Who Is Multiracial? Assessing the Complexity of Lived Race
Harris, D., & Sim, J. J. (2002) · American Sociological Review · doi:10.2307/3088948 · Cited by 658 · see citing works
Racial fault lines: the historical origins of white supremacy in California
(1995) · Choice Reviews Online · doi:10.5860/choice.32-5259 · Cited by 621 · see citing works
Who Is Black? One Nation's Definition.
Daniel, G. R., & Davis, F. J. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075727 · Cited by 601 · see citing works
Shades of citizenship: race and the census in modern politics
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5287 · Cited by 458 · see citing works
Does it matter who answers the race question? Racial classification and income inequality in Brazil
Telles, E. E., & Lim, N. (1998) · Demography · doi:10.2307/3004014 · Cited by 280 · see citing works
New People: Miscegenation and Mulattoes in the United States.
Kirby, J. T., & Williamson, J. (1981) · The Journal of Southern History · doi:10.2307/2207421 · Cited by 231 · see citing works
The Racial Identification of Biracial Children with One Asian Parent: Evidence from the 1990 Census
Xie, Y., & Goyette, K. A. (1997) · Social Forces · doi:10.1093/sf/76.2.547 · Cited by 198 · see citing works
Hahn, R. A., Mulinare, J., & Teutsch, S. M. (1992) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.1992.03480020069033 · Cited by 193 · see citing works
Racial ambiguity among the Brazilian population
Telles, E. (2002) · Ethnic and Racial Studies · doi:10.1080/01419870252932133 · Cited by 186 · see citing works
The Origins and Demise of the Concept of Race
Hirschman, C. (2004) · Population and Development Review · doi:10.1111/j.1728-4457.2004.00021.x · Cited by 163 · see citing works
Hill, M. E. (2002) · American Sociological Review · doi:10.2307/3088935 · Cited by 154 · see citing works
The Cultural Territories of Race: Black and White Boundaries
Stearns, E., & Lamont, M. (2001) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2655378 · Cited by 88 · see citing works
The Ethnic Responses of Whites: What Causes Their Instability, Simplification, and Inconsistency?
Lieberson, S., & Waters, M. C. (1993) · Social Forces · doi:10.2307/2579855 · Cited by 81 · see citing works
The multiple-race population of the United States: Issues and estimates
Goldstein, J. R., & Morning, A. J. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.100086897 · Cited by 78 · see citing works
Skin Color and Latinos in the United States
Montalvo, F. F., & Codina, G. E. (2001) · Ethnicities · doi:10.1177/146879680100100303 · Cited by 75 · see citing works
The Use of the Conceptual Category of Race in American Sociology, 1937–99
Martin, J. L., & Yeung, K.-T. (2003) · Sociological Forum · doi:10.1023/b:sofo.0000003002.90428.c2 · Cited by 65 · see citing works
Sugarman, J. R., Soderberg, R., Gordon, J., & Rivara, F. P. (1993) · American Journal of Public Health · doi:10.2105/ajph.83.5.681 · Cited by 60 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Towards a critical race methodology in algorithmic fairness
Hanna, A., Denton, R., Smart, A., & Smith-Loud, J. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372826 · Cited by 295 · see citing works
“This in turn can significantly impact health statistics [62, 101], population statistics [8, 74], and measures of social inequality [102].”
Does Multiracial Matter? A Study of Racial Disparities in Self-Rated Health
Bratter, J. L., & Gorman, B. K. (2011) · Demography · doi:10.1007/s13524-010-0005-0 · Cited by 83 · see citing works
Passing It On: Parent-to-Adult Child Financial Transfers for School and Socioeconomic Attainment
Rauscher, E. (2016) · RSF: The Russell Sage Foundation Journal of the Social Sciences · doi:10.7758/rsf.2016.2.6.09 · Cited by 67 · see citing works
- Authors
- Saperstein, A.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Saperstein, A.
- ORCID
- Saperstein, A.
- Venue
- Social Forces
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-09-01
- Volume
- 85
- Issue
- 1
- Pages
- 57-74
- ISSN
- 0037-7732 (ISSN-L)
- 1534-7605
- OpenAlex
- W2170463344
- Cited by
- 137
- References
- 21
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 6 · 2023: 5 · 2022: 12 · 2021: 11 · 2020: 7 · 2019: 8 · 2018: 8 · 2017: 8 · 2016: 10 · 2015: 11 · 2014: 7 · 2013: 8 · 2012: 5
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Social Forces (publishedVersion)
- Project Muse (Johns Hopkins University) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Sociology and Political Science › Intergenerational and Educational Inequality Studies
- Keywords
- racial classification, self-reported race, measurement discrepancy, income inequality, social construction of race, immigrant generations, educational attainment, age, General Social Survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review