Systemic Discrimination Among Large U.S. Employers
Open accessAbstract
We study the results of a massive nationwide correspondence experiment sending more than 83,000 fictitious applications with randomized characteristics to geographically dispersed jobs posted by 108 of the largest U.S. employers. Distinctively Black names reduce the probability of employer contact by 2.1 percentage points relative to distinctively white names. The magnitude of this racial gap in contact rates differs substantially across firms, exhibiting a between-company standard deviation of 1.9 percentage points. Despite an insignificant average gap in contact rates between male and female applicants, we find a between-company standard deviation in gender contact gaps of 2.7 percentage points, revealing that some firms favor male applicants while others favor women. Company-specific racial contact gaps are temporally and spatially persistent, and negatively correlated with firm profitability, federal contractor status, and a measure of recruiting centralization. Discrimination exhibits little geographical dispersion, but two digit industry explains roughly half of the cross-firm variation in both racial and gender contact gaps. Contact gaps are highly concentrated in particular companies, with firms in the top quintile of racial discrimination responsible for nearly half of lost contacts to Black applicants in the experiment. Controlling false discovery rates to the 5% level, 23 individual companies are found to discriminate against Black applicants. Our findings establish that systemic illegal discrimination is concentrated among a select set of large employers, many of which can be identified with high confidence using large scale inference methods.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A recent large-scale correspondence audit study in the United States found that contact rates for male and female gender applicants differed significantly between firms, with some employers favouring male and others favouring female candidates.
“a recent large-scale correspondence audit study conducted in the United States (with more than 80,000 applications) in which the authors found that contact rates for male gender and female gender applicants differed significantly between firms: some employers favoured male gender candidates, while others favoured female gender candidates (Kline et al., 2021).”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Kline et al., 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Mapping the Margins: Intersectionality, Identity Politics, and Violence against Women of Color
Crenshaw, K. (1991) · Stanford Law Review · doi:10.2307/1229039 · Cited by 29,585 · see citing works
Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood
Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014) · American Economic Review · doi:10.1257/aer.104.9.2633 · Cited by 1,717 · see citing works
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887 · see citing works
Prejudice Reduction: Progress and Challenges
Paluck, E. L., Porat, R., Clark, C. S., & Green, D. P. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-071620-030619 · Cited by 686 · see citing works
Flagged first, then by citations
Research works printed but not linked: 56
- Abaluck, Jason, Mauricio Caceres Bravo, Peter Hull, and Amanda Starc. 2021. "Mortality effects and choice across private health insurance plans." The Quarterly Journal of Economics, 136(3): 1557-1610.
- Agan, Amanda, and Sonja Starr. 2018. "Ban the box, criminal records, and racial discrimination: A field experiment." The Quarterly Journal of Economics, 133(1): 191- 235.
- Aigner, Dennis J, and Glen G Cain. 1977. "Statistical theories of discrimination in labor markets." Ilr Review, 30(2): 175-187.
- Anatolyev, Stanislav, and Mikkel Sølvsten. 2020. "Testing Many Restrictions Un- der Heteroskedasticity." arXiv preprint arXiv:2003.07320. · arXiv
- Angrist, Joshua D, and Alan B Krueger. 1995. "Split-sample instrumental vari- ables estimates of the return to schooling." Journal of Business & Economic Statistics, 13(2): 225-235.
- Angrist, Joshua D., Peter D. Hull, Parag A. Pathak, and Christopher R. Walters. 2017. "Leveraging lotteries for school value-Added: Testing and estimation." The Quarterly Journal of Economics, 132(2): 871-919.
- Arceo-Gomez, Eva O, and Raymundo M Campos-Vazquez. 2014. "Race and marriage in the labor market: A discrimination correspondence study in a developing country." American Economic Review, 104(5): 376-80.
- Armstrong, Timothy. 2015. "Adaptive testing on a regression function at a point." Annals of Statistics, 43(5): 2086-2101.
- Arnold, David, Will Dobbie, and Crystal S Yang. 2018. "Racial Bias in Bail Decisions." The Quarterly Journal of Economics, 133(4): 1885-1932.
- Avivi, Hadar, Patrick Kline, Evan Rose, and Christopher Walters. 2021. "Adap- tive Correspondence Experiments." AEA Papers and Proceedings, 111: 43-48.
- Baert, Stijn. 2018. "Hiring discrimination: an overview of (almost) all correspondence experiments since 2005." In Audit studies: Behind the scenes with theory, method, and nuance. 63-77. Springer.
- Bai, Yuehao, Andres Santos, and Azeem M Shaikh. 2021. "A Two-Step Method for Testing Many Moment Inequalities." Journal of Business & Economic Statistics, 1-33.
- Banerjee, Rupa, Jeffrey G Reitz, and Phil Oreopoulos. 2018. "Do large employers treat racial minorities more fairly? An analysis of Canadian field experiment data." Canadian Public Policy, 44(1): 1-12.
- Becker, Gary S. 1957. The Economics of Discrimination. University of Chicago Press.
- Becker, Gary S. 1993. "Nobel lecture: The economic way of looking at behavior." Journal of Political Economy, 101(3): 385-409.
- Benjamini, Yoav, and Yosef Hochberg. 1995. "Controlling the false discovery rate: a practical and powerful approach to multiple testing." Journal of the Royal statistical society: series B (Methodological), 57(1): 289-300.
- Bergman, Peter, Danielle Li, and Lindsey Raymond. 2020. "Hiring as explo- ration." Available at SSRN 3630630.
- Bertrand, Marianne, and Esther Duflo. 2017. "Field experiments on discrimina- tion." In Handbook of Field Experiments. Vol. 1, , ed. Esther Duflo and Abhijit Baner- jee. Elsevier.
- Bertrand, Marianne, and Sendhil Mullainathan. 2004. "Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimina- tion." American Economic Review, 94(4): 991-1013.
- Bertrand, Marianne, Sandra E Black, Sissel Jensen, and Adriana Lleras- Muney. 2019. "Breaking the glass ceiling? The effect of board quotas on female labour market outcomes in Norway." The Review of Economic Studies, 86(1): 191-239.
- Black, Dan A. 1995. "Discrimination in an equilibrium search model." Journal of labor Economics, 13(2): 309-334.
- Bowlus, Audra J, and Zvi Eckstein. 2002. "Discrimination and skill differences in an equilibrium search model." International Economic Review, 43(4): 1309-1345.
- Charles, Kerwin Kofi, and Jonathan Guryan. 2008. "Prejudice and wages: an empirical assessment of Becker's The Economics of Discrimination." Journal of Political Economy, 116(5): 773-809.
- Chetty, Raj, and Nathaniel Hendren. 2018. "The impacts of neighborhoods on intergenerational mobility I: Childhood exposure effects." The Quarterly Journal of Economics, 133(3): 1107-1162.
- Dahl, Gordon B, Andreas Kotsadam, and Dan-Olof Rooth. 2021. "Does integra- tion change gender attitudes? The effect of randomly assigning women to traditionally male teams." The Quarterly Journal of Economics, 136(2): 987-1030.
- Deming, David J. 2017. "The growing importance of social skills in the labor market." The Quarterly Journal of Economics, 132(4): 1593-1640.
- Deming, David J, Noam Yuchtman, Amira Abulafi, Claudia Goldin, and Lawrence F Katz. 2016. "The value of postsecondary credentials in the labor market: An experimental study." American Economic Review, 106(3): 778-806.
- Donoho, David, and Jiashun Jin. 2004. "Higher criticism for detecting sparse het- erogeneous mixtures." The Annals of Statistics, 32(3): 962-994.
- Efron, Bradley. 2016. "Empirical Bayes deconvolution estimates." Biometrika, 103(1): 1-20.
- Efron, Bradley, and Robert Tibshirani. 1996. "Using specially designed exponential families for density estimation." Annals of Statistics, 24(6): 2431-2461.
- Efron, Bradley, Robert Tibshirani, John D Storey, and Virginia Tusher. 2001. "Empirical Bayes analysis of a microarray experiment." Journal of the American sta- tistical association, 96(456): 1151-1160.
- Fang, Albert H, Andrew M Guess, and Macartan Humphreys. 2019. "Can the government deter discrimination? Evidence from a randomized intervention in New York City." The Journal of Politics, 81(1): 127-141.
- Feigenberg, Benjamin, and Conrad Miller. 2021. "Would eliminating racial dis- parities in motor vehicle searches have efficiency costs?" The Quarterly Journal of Economics. qjab018.
- Fryer Jr, Roland G, and Steven D Levitt. 2004. "The causes and consequences of distinctively black names." The Quarterly Journal of Economics, 119(3): 767-805.
- Gaddis, S. Michael. 2017. "How Black Are Lakisha and Jamal? Racial perceptions from names used in correspondence audit studies." Sociological Science, 4(19): 469-489.
- Goldin, Claudia. 2014. "A pollution theory of discrimination: male and female differ- ences in occupations and earnings." In Human capital in history: The American record. 313-348. University of Chicago Press.
- Gu, Jiaying, and Roger Koenker. 2020. "Invidious Comparisons: Ranking and Se- lection as Compound Decisions." arXiv preprint arXiv:2012.12550. · arXiv
- Hangartner, Dominik, Daniel Kopp, and Michael Siegenthaler. 2021. "Monitoring hiring discrimination through online recruitment platforms." Nature, 589(7843): 572-576.
- Holzer, Harry J, and Keith R Ihlanfeldt. 1998. "Customer discrimination and employment outcomes for minority workers." The Quarterly Journal of Economics, 113(3): 835-867.
- Huang, Bert I. 2004. "The'Inexorable Zero'." Harvard Law Review, 117(4): 1215.
- Kline, Patrick M, and Christopher R Walters. 2021. "Reasonable doubt: Exper- imental detection of job-level employment discrimination." Econometrica, 89(2): 765- 792.
- Kline, Patrick, Raffaele Saggio, and Mikkel Sølvsten. 2020. "Leave-out estimation of variance components." Econometrica, 88(5): 1859-1898.
- Leonard, Jonathan S, David I Levine, and Laura Giuliano. 2010. "Customer discrimination." The Review of Economics and Statistics, 92(3): 670-678.
- Narasimhan, Balasubramanian, and Bradley Efron. 2020. "deconvolveR: A G- Modeling Program for Deconvolution and Empirical Bayes Estimation." Journal of Statistical Software, 94(1): 1-20.
- Neumark, David, Ian Burn, and Patrick Button. 2018. "Is it harder for older workers to find jobs? New and improved evidence from a field experiment." Journal of Political Economy, 127(2): 922-970.
- Nunley, John M, Adam Pugh, Nicholas Romero, and R Alan Seals. 2015. "Racial discrimination in the labor market for recent college graduates: Evidence from a field experiment." The BE Journal of Economic Analysis & Policy, 15(3): 1093-1125.
- Onwuachi-Willig, Angela, and Mario L. Barnes. 2005. "By any other name: on being regarded as Black, and why Title VII should apply even if Lakisha and Jamal are white." Wisconsin Law Review, 1283.
- Pager, Devah, Bart Bonikowski, and Bruce Western. 2009. "Discrimination in a low-wage labor market: A field experiment." American sociological review, 74(5): 777- 799.
- Quillian, Lincoln, John J Lee, and Mariana Oliver. 2020. "Evidence from field experiments in hiring shows substantial additional racial discrimination after the call- back." Social Forces, 99(2): 732-759.
- Rose, Evan K. 2020. "Who gets a second chance? Effectiveness and equity in supervi- sion of criminal offenders." The Quarterly Journal of Economics, 136(2): 1199-1253.
- Silverman, Bernard W. 1986. Density estimation for statistics and data analysis. Vol. 26, CRC press.
- Stephens-Davidowitz, Seth. 2014. "The cost of racial animus on a black candidate: Evidence using Google search data." Journal of Public Economics, 118: 26-40.
- Storey, John D. 2002. "A direct approach to false discovery rates." Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(3): 479-498.
- Storey, John D. 2003. "The positive false discovery rate: a Bayesian interpretation and the q-value." The Annals of Statistics, 31(6): 2013-2035.
- Storey, John D, and Robert Tibshirani. 2003. "Statistical significance for genomewide studies." Proceedings of the National Academy of Sciences, 100(16): 9440- 9445.
- Tilcsik, Andras. 2011. "Pride and prejudice: employment discrimination against openly gay men in the United States." American Journal of Sociology, 117(2): 586--626.
Cited by
Sorted by citations
Lippens, L., Vermeiren, S., & Baert, S. (2023) · European Economic Review · doi:10.1016/j.euroecorev.2022.104315
- Authors
- Kline, P., Rose, E. K., & Walters, C.
- Affiliations
- University of California, Berkeley (US)
- University of Chicago (US)
- Corresponding author
- Rose, Evan K.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2021
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W3192577694
- Cited by
- 3
- References
- 4
- Citations by year
- 2023: 1 · 2022: 2
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Safety Research › Experimental Behavioral Economics Studies
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- institutional discrimination, racial discrimination, gender discrimination, hiring discrimination, correspondence experiment, Black applicants, large employers, federal contractors, firm profitability, industry effects, false discovery rate, large-scale inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review