Cited by 283Names, Identity, and Discrimination ResearchSocial and Intergroup PsychologyRacial and Ethnic Identity Research

Do Some Countries Discriminate More than Others? Evidence from 97 Field Experiments of Racial Discrimination in Hiring

Open access
Quillian, Lincoln, Heath, Anthony, Pager, Devah, Midtbøen, Arnfinn, Fleischmann, Fenella, Hexel, Ole·2019·Sociological Science

Abstract

Comparing levels of discrimination across countries can provide a window into large-scale social and political factors often described as the root of discrimination. Because of difficulties in measurement, however, little is established about variation in hiring discrimination across countries. We address this gap through a formal meta-analysis of 97 field experiments of discrimination incorporating more than 200,000 job applications in nine countries in Europe and North America. We find significant discrimination against nonwhite natives in all countries in our analysis; discrimination against white immigrants is present but low. However, discrimination rates vary strongly by country: In high-discrimination countries, white natives receive nearly twice the callbacks of nonwhites; in low-discrimination countries, white natives receive about 25 percent more. France has the highest discrimination rates, followed by Sweden. We find smaller differences among Great Britain, Canada, Belgium, the Netherlands, Norway, the United States, and Germany. These findings challenge several conventional macro-level theories of discrimination.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.15195/v6.a18

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Norway inconsistency may be because the GEMM study included only private sector employers and discrimination is higher in this sector, whereas the Norwegian studies in Quillian et al. (2019) included both private and public employers.

    “This may be because the GEMM study included only private sector employers and discrimination is higher in this sector (see point 9), whereas the Norwegian studies in the meta-analysis by Quillian et al. (2019) included both private and public employers.”

    From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2019)

    The paper’s Discussion reports a discrimination estimate for Norway, confirming that Norwegian studies were included in the meta-analysis. Our copy does not say whether those studies included both private- and public-sector employers; searches for those sector terms did not establish the claimed explanation for the difference from GEMM. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • Quillian et al. (2019) find substantial differences over countries-in some countries Whites receive 80-100% more job offers than non-Whites, but in others they receive only 20-30% more.

    “They find substantial differences over countries-in some countries Whites receive 80-100% more job offers than non-Whites, but in others they receive only 20-30% more.”

    From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2019)

    The Results report substantial country differences: white natives received 75–102% more callbacks in France and Sweden and 22–41% more in Germany, the United States, and Norway. This broadly supports the comparison, but the paper measures callbacks, not job offers, and its lower-discrimination range extends beyond the claimed 20–30%. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • The meta-analyses by Zschirnt & Ruedin (2016) and Quillian et al. (2019) find no statistically significant or substantively large difference in discrimination over immigrant generation groups.

    “Similarly, the meta-analyses by Zschirnt & Ruedin (2016) and Quillian et al. (2019) find no statistically significant or substantively large difference in discrimination over immigrant generation groups.”

    From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2019)

    In the Results (page unavailable), Quillian et al. report that being foreign-born did not significantly predict the discrimination ratio; Table 3 (indexed under Notes, page unavailable) gives a small coefficient of −0.06. This supports a limited foreign-born versus native-born comparison, but the paper does not report a comparison across immigrant generation groups more broadly, and it cautions that low variability may explain the nonsignificant result. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Discrimination against White immigrants is low in North America, Western Europe, and Australia.

    “For White immigrants, discrimination appears to be low in North America, Western Europe, and Australia-this pattern is also apparent in”

    From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2019)

    The Discussion says white immigrants face less hiring discrimination than nonwhite applicants and that their disadvantage relative to white natives is often small and statistically insignificant. The Results list countries in Europe and North America, but not Australia, so the paper does not support extending this finding to Australia. (LLM, conf=0.89)

    Experimental — accuracy not yet measured
  • The White majority receives between 20% and 80% more callbacks than non-White groups depending on the group and the country.

    “Theirmeta-analysis suggests that the White majority receives between 20% and 80% more callbacks than non-White groups depending on the group and the country.”

    From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2019)

    The Results report that white natives received 22–41% more callbacks in Germany, the United States, and Norway, but 75–102% more in France and Sweden. The claim captures the direction and cross-country variation, but its 80% upper bound understates the reported range. (LLM, conf=0.93)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 51

  1. Akintola, Abayomi Rasheed. 2010. "Hiring Discrimination in Racially Diverse Labour Markets: A Cross Country Study." Thesis, Karlstad Business School, Karlstad, University.
  2. Alba, Richard, and Nancy Foner. 2015. Strangers No More: Immigration and the Challenges of Integration in North America and Western Europe. Princeton, NJ: Princeton University Press. https://doi.org/10.3917/popu.1503.0673. American Anthropological Association. 1997. "Response to OMB Directive 15." https://s3.amazonaws.com/rdcms-aaa/files/production/public/FileDownloads/ pdfs/cmtes/minority/upload/AAA_Response_OMB1997.pdf. · DOI
  3. Auspurg, Katrin, Andreas Schneck, and Thomas Hinz. 2018. "Closed Doors Everywhere? A Meta-analysis of Field Experiments of Ethnic Discrimination in Rental Housing Markets." Journal of Ethnic and Migration Studies 45:95-114. https://doi.org/10.1080/1369183x. 2018.1489223. · DOI
  4. Baert, Stein. 2018. "Hiring Discrimination, and Overview of (Almost) All Correspondence Experiments Since 2005." Pp. 63-77 in Audit Studies: Behind the Scenes with Theory, Method, and Nuance, edited by S. M. Gaddis. New York, NY: Springer International Publishing. https://doi.org/10.1007/978-3-319-71153-9_3. · DOI
  5. Beaman, Jean. 2017. Citizen Outsider: Children of North African Immigrants in France. Berkeley, CA: University of California Press. https://doi.org/10.1525/luminos.39. Berrey, Ellen, Robert L. Nelson, and Laura Beth Nielsen. 2017. Rights on Trial: How Workplace Discrimination Law Perpetuates Inequality. Chicago, IL: University of Chicago Press. https: //doi.org/10.1086/701591. · DOI
  6. Bertrand, Marianne, and Sendhil Mullainathan. 2004. "Are Emily and Greg More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination." The American Economic Review 94:991-1013. https://doi.org/10.1257/0002828042002561. · DOI · Paper page
  7. Blalock, Hubert. 1967. Toward a Theory of Minority-Group Relations. New York, NY: Wiley.
  8. Branton, Regina, Erin C. Cassese, Bradford S. Jones, and Chad Westerland. 2011. "All Along the Watchtower: Acculturation Fear, Anti-Latino Affect, and Immigration. The Journal of Politics 73:664-79. https://doi.org/10.1017/s0022381611000375. · DOI
  9. Dobbin, Frank. 2011. Inventing Equal Opportunity. Princeton, NJ: Princeton University Press. https://doi.org/10.1017/s0022050712000472. · DOI
  10. European Union Agency for Fundamental Rights. 2008. Annual Report 2008. Vienna, Switzer- land: European Union Agency for Fundamental Rights. https://doi.org/10.5040/ 9781472563231.ch-010. · DOI
  11. Feagin, Joe R., and Melvin P. Sikes. 1994. Living with Racism: The Black Middle-Class Experience. Boston, MA: Beacon Press.
  12. Fisher, Zachary, and Elizabeth Tipton. 2015. "Robumeta: An R-package for Robust Variance Estimation in Meta-analysis." Cornell University. https://arxiv.org/abs/1503.02220. · arXiv
  13. Fredrickson, George M. 2002. Racism: A Short History. Princeton, NJ: Princeton University Press.
  14. Gaddis, Michael. 2017. "How Black Are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit Studies." Sociological Science 4:469-89. https: //doi.org/10.15195/v4.a19. · DOI
  15. Golder, Matt. 2016. "Far Right Parties in Europe." Annual Review of Political Science 19:477-97. https://doi.org/10.1146/annurev-polisci-042814-012441. · DOI
  16. Heath, Anthony, Thomas Liebig, and Patrick Simon. 2013. "Discrimina- tion against Immigrants -Measurement, Incidence and Policy Instruments." OECD iLibrary. http://www.oecd-ilibrary.org/social-issues-migration-health/ international-migration-outlook-2013_migr_outlook-2013-en.
  17. Heath, Anthony F., and Sin Yi Cheung. 2007. Unequal Chances: Ethnic Minorities in West- ern Labour Markets. Oxford, United Kingdom: Oxford University Press for the British Academy. https://doi.org/10.5871/bacad/9780197263860.001.0001. · DOI
  18. Heckman, James J., and Peter Siegelman. 1992. "The Urban Institute Audit Studies: Their Methods and Findings," Pp. 187-258 in Clear and Convincing Evidence: Measurement of Discrimination in America, edited by M. Fix and R. J. Struyk. Lanham, MD: Urban Institute Press.
  19. Heckman, James J. 1998. "Detecting Discrimination." Journal of Economic Perspectives 12:101- 16.
  20. Hedges, Larry V., Elizabeth Tipton, and Matthew C. Johnson. 2010. "Robust Variance Estimation in Meta-regression with Dependent Effect Size Estimates." Research Synthesis Methods 1:39-65. https://doi.org/10.1002/jrsm. · DOI · Paper page
  21. Jonsson Jan O., Frank Kalter, and Frank van Tubergen. 2018. "Studying Integration: Ethnic Minority and Majority Youth in Comparative Perspective." Pp.3-39 in Growing up in Diverse Societies: The Integration of the Children of Immigrants in England, Germany, the Netherlands, and Sweden, edited by F. Kalter, J. O. Jonsson, F. van Tubergen, and A. Francis. Oxford, United Kingdom: Oxford University Press. https://doi.org/10.5871/bacad/ 9780197266373.003.0001. · DOI
  22. Lancee, Bram. 2010. "The Economic Returns of Immigrants' Bonding and Bridging Social Capital: The Case of the Netherlands." International Migration Review 44:202-26. https: //doi.org/10.1111/j.1747-7379.2009.00803.x. · DOI
  23. Legewie, Joscha. 2013. "Terrorist Events and Attitudes toward Immigrants: A Natural Experiment." American Journal of Sociology 118:1199-245. https://doi.org/10.1086/ 669605. · DOI
  24. Leonard, Jonathan S. 1990. "The Impact of Affirmative Action Regulation and Equal Employment Law on Black Employment." Journal of Economic Perspectives 4:439-463. https://doi.org/10.1257/jep.4.4.47. Meyer, John W., John Boli, George M. Thomas, and Francisco O. Ramirez. 1997. "World Society and the Nation-State." American Journal of Sociology 103:144-81. https://doi. org/10.1086/231174. · DOI
  25. National Research Council. 2004. Measuring Racial Discrimination. Washington, DC: National Academies Press.
  26. Neumark, David. 2012. "Detecting Discrimination in Audit and Correspondence Studies." Journal of Human Resources 47:1128-57. https://doi.org/10.3368/jhr.47.4.1128. · DOI
  27. Neumark, David. 2018. "Experimental Research on Labor Market Discrimination." Journal of Economic Literature 56:799-866. https://doi.org/10.1257/jel.20161309. · DOI · Paper page
  28. O'Connell, Heather A. 2012. "The Impact of Slavery on Racial Inequality in Poverty in the Contemporary U.S. South." Social Forces 90:713-34. https://doi.org/10.1093/sf/ sor021. Organisation for Economic Co-operation and Development. 2015. Indicators of Immigrant Integration 2015: Settling In. Paris, France: OECD Publishing. http://dx.doi.org/10. 1787/9789264234024-en. · DOI
  29. Pager, Devah, and Lincoln Quillian. 2005. "Walking the Talk? What Employers Say Versus What They Do." American Sociological Review 70:355-80. https://doi.org/10.1177/ 000312240507000301. · DOI · Paper page
  30. Pager, Devah. 2007. "The Use of Field Experiments for Studies of Employment Dis- crimination: Contributions, Critiques, and Directions for the Future." Annals of the American Academy of Political and Social Science 609:104-33. https://doi.org/10.1177/ 0002716206294796. · DOI
  31. Pager, Devah, and Hana Shepherd. 2008. "The Sociology of Discrimination: Racial Discrim- ination in Employment, Housing, Credit, and Consumer Markets." Annual Review of Sociology 34:181-209. https://doi.org/10.1146/annurev.soc.33.040406.131740. · DOI
  32. Quillian, Lincoln. 1995. "Prejudice as a Response to Perceived Group Threat: Population Composition and Anti-Immigrant and Racial Prejudice in Europe." American Sociological Review 60:586-611. https://doi.org/10.2307/2096296. · DOI
  33. Quillian, Lincoln. 2006. "New Approaches to Understanding Racial Prejudice and Discrim- ination." Annual Review of Sociology 32:299-328. https://doi.org/10.1146/annurev. soc.32.061604.123132. · DOI
  34. Raftery, Adrian E. 1995. "Bayesian Model Selection in Social Research." Sociological Methodol- ogy 25:111-63. https://doi.org/10.2307/271063. · DOI · Paper page
  35. Riach, Peter A., and Judith Rich. 2002. "Field Experiments of Discrimination in the Mar- ket Place." The Economic Journal 112:F480-518. https://doi.org/10.1111/1468-0297. 00080. · DOI · Paper page
  36. Schlueter, Elmar, and Peer Scheepers. 2010. "The Relationship between Outgroup Size and Anti-Outgroup Attitudes: A Theoretical Synthesis and Empirical Test of Group Threat and Intergroup Contact Theory." Social Science Research 39:285-95. https://doi.org/10. 1016/j.ssresearch.2009.07.006. · DOI
  37. Semyonov, Moshe, Rebeca Raijman, and Anastasia Gorodzeisky. 2006. "The Rise of Anti- Foreigner Sentiment in European Societies, 1988-2000." American Sociological Review 71:426-49. https://doi.org/10.1177/000312240607100304. sociological science | www.sociologicalscience.com · DOI
  38. Sidanius, Jim, and Felicia Pratto. 2001. Social Dominance: An Intergroup Theory of Social Hierarchy and Oppression. Cambridge, United Kingdom: Cambridge University Press. https://doi.org/10.1017/cbo9781139175043.014. · DOI
  39. Simon, Patrick. 2008. "The Choice of Ignorance: The Debate on Ethnic and Racial Statistics in France." French Politics, Culture & Society 26-1:7-31. https://doi.org/10.3167/fpcs. 2008.260102. · DOI
  40. Sniderman, Paul, and Louk Hagendoorn. 2007. When Ways of Life Collide: Multiculturalism and Its Discontents in the Netherlands. Princeton, NJ: Princeton University Press. https: //doi.org/10.1007/s11562-008-0039-x. · DOI
  41. Sutton, Alex J. 2009. "Publication bias." Pp. 435-52 in The Handbook of Research Synthesis and Meta-Analysis, edited by H. M. Cooper, L. V. Hedges, and J. C. Valentine. New York, NY: Russell Sage Foundation.
  42. Taylor, Marylee. 1998. "How White Attitudes Vary with the Racial Composition of Local Populations: Numbers Count." American Sociological Review 63:512-35. https://doi. org/10.2307/2657265. · DOI
  43. van de Werfhorst, Herman G., and Anthony Heath. 2019. "Selectivity of Migration and the Educational Disadvantages of Second-Generation Immigrants in Ten Host Societies." Eu- ropean Journal of Population 35:347-78. https://doi.org/10.1007/s10680-018-9484-2. · DOI
  44. Viechtbauer, Wolfgang. 2010. "Conducting Meta-analyses in R with the Metafor Package." Journal of Statistical Software 36:1-48.
  45. Vuolo, Michael, Christopher Uggen, and Sarah Lageson. 2017. "Race, Recession, and Social Closure in the Low-Wage Labor Market: Experimental and Observational Ev- idence." Research in the Sociology of Work 30:141-83. https://doi.org/10.1108/ s0277-283320170000030007. · DOI
  46. Wilson, William Julius. 2012. The Declining Significance of Race: Blacks and Changing American Institutions. 3rd ed. Chicago, IL: University Of Chicago Press. https://doi.org/10. 1093/sw/24.4.352-a. · DOI
  47. Wozniac, Abigail. 2015. "Discrimination and the Effects of Drug Testing on Black Employ- ment." The Review of Economics and Statistics 97:548-66.
  48. Xie, Yu, and Margaret Gough. 2011. "Ethnic Enclaves and the Earnings of Immigrants." Demography 48:1293-315. https://doi.org/10.1007/s13524-011-0058-8. · DOI
  49. Zhou, Guang Yong. 2007. "One Relative Risk versus Two Odds Ratios: Implications for Meta-analyses Involving Paired and Unpaired Binary Data." Clinical Trials 4:25-31. https://doi.org/10.1177/1740774506075667. · DOI
  50. Zschirnt, Eva, and Didier Ruedin. 2016. "Ethnic Discrimination in Hiring Decisions: A Meta-analysis of Correspondence Tests 1990-2015." Journal of Ethnic and Migration Studies 42:1115-34. http://dx.doi.org/10.1080/1369183X.2015.1133279. · DOI · Paper page
  51. Zucotti, Carolina V., and Lucinda Platt. 2017. "Does Neighbourhood Ethnic Concentration in Early Life Affect Subsequent Labour Market Outcomes? A Study across Ethnic Groups in England and Wales." Population, Space and Place 23:e2041. https://doi.org/10.1002/ psp.2041. · DOI

Cited by

Sorted by citations

Authors
Quillian, L., Heath, A., Pager, D., Midtbøen, A., Fleischmann, F., & Hexel, O.
Affiliations
  • Northwestern University (US)
  • Institute for Social Research (NO)
  • Utrecht University (NL)
  • Centre National de la Recherche Scientifique (FR)
Venue
Sociological Science
Published
2019
Volume
6
Pages
467-496
ISSN
2330-6696 (ISSN-L)
OpenAlex
W2950049906
Cited by
283
References
4
Citations by year
2026: 26 · 2025: 50 · 2024: 46 · 2023: 47 · 2022: 38 · 2021: 45 · 2020: 27 · 2019: 3 · 2014: 1
FWCI
53.26
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Sociological Science (publishedVersion, cc-by)
  • SPIRE (Sciences Po) (submittedVersion)
  • HAL (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
Funders
  • Russell Sage Foundation
  • Sage Foundation
  • Northwestern University
Topics
  • Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
  • Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
  • Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
Keywords
racial discrimination, hiring discrimination, cross-national comparison, field experiments, immigrants, France, Sweden, Great Britain, Canada, Belgium, Netherlands, Norway, United States, Germany

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review