Cited by 180Names, Identity, and Discrimination ResearchSocial and Intergroup PsychologyRacial and Ethnic Identity Research

Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments

Open access
Quillian, Lincoln, Midtbøen, Arnfinn H.·2021·Annual Review of Sociology

Abstract

This article reviews studies of hiring discrimination against racial and ethnic minority groups in cross-national perspective. We focus on field experimental studies of hiring discrimination: studies that use fictitious applications from members of different racial and ethnic groups to apply for actual jobs. There are more than 140 field experimental studies of hiring discrimination against ethno-racial minority groups in 30 countries. We outline seventeen empirical findings from this body of studies. We also discuss individual and contextual theories of hiring discrimination, the relative strengths and weaknesses of field experiments to assess discrimination, and the history of such field experiments. The comparative scope of this body of research helps to move beyond micromodels of employer decision-making to better understand the roles of history, social context, institutional rules, and racist ideologies in producing discrimination. These studies show that racial and ethnic discrimination is a pervasive international phenomenon that has hardly declined over time, although levels vary significantly over countries. Evidence indicates that institutional rules regarding race and ethnicity in hiring can have an important influence on levels of discrimination. Suggestions for future research on discrimination are discussed.

AI snapshot

Written from the paper’s full text.

TL;DR

This review synthesizes more than 140 field experiments of racial and ethnic discrimination in hiring across 30 countries, locating 147 studies. It concludes that discrimination against non-White groups is pervasive and has hardly declined over time in the United States and United Kingdom, though levels vary substantially by country and context.

Key findings

  • Discrimination against non-Whites is ubiquitous: across 129 country-by-race estimates, the average discrimination ratio is 1.45, meaning Whites receive about 50% more callbacks than non-Whites on average; ratios range from 1.0 (European/White in the Netherlands) to 3.07 (Middle Eastern/North African groups in Israel).
  • Country variation is substantial, and the United States has rates similar to lower-rate European countries; in the United States and United Kingdom, field experiments show no change in hiring discrimination over the past 25 years.
  • Context and institutions matter: larger employers and public-sector employers discriminate less; formalized hiring procedures, transparency, and accountability can reduce discrimination; cultural distance, Muslim religious signals, and criminal background are associated with additional disadvantage, though effects vary.
  • Field experiments using only callback outcomes underestimate total hiring discrimination: studies following applicants to job offers find roughly as much discrimination after the callback as up to it, suggesting callback-based estimates understate discrimination by about a factor of two.

Methods

  • The paper is a cross-national review and meta-analysis of field experimental studies of racial/ethnic discrimination in hiring, including in-person audit studies and resume/correspondence studies using fictitious matched applicants.
  • The authors searched studies in multiple languages, examined references, and surveyed experts, locating 147 distinct studies in 30 countries; they also draw on formal meta-analyses and the GEMM cross-national project.
  • Main analyses compute discrimination ratios (White native callbacks relative to minority applicants), use random-effects meta-regression, and compare country, group, and study characteristics.

Limitations

  • The paper states that field experiments are usually not feasible for decisions involving extensive prior contact, such as internal promotions; external validity is difficult to evaluate; callback outcomes omit post-callback discrimination; name signals may connote class or immigration status and only 17.5% of resume audits use name pretests; and there is no established way to use field experimental results to determine how much discrimination creates racial disparities.
  • The review states that there are only a few field experiments outside North America, Europe, and Australia, and that studies of racism and studies of discrimination remain highly separate, limiting understanding of how racist ideologies correspond to discriminatory acts.
  • Evident from the text: the review’s conclusions depend on the designs, samples, and outcome measures of the included studies, which are not completely uniform across occupations, applicant details, and target groups.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1146/annurev-soc-090420-035144

Cites

141 of 141 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

37 of 103 cited sources checked · 23 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Even equal treatment at the callback level may conceal subtler differences in treatment, as shown by Zschirnt (2019).

    “Additionally, even equal treatment at the callback level may conceal subtler differences in treatment, as shown by Zschirnt (2019).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Zschirnt (2019) source
  • Interpretationcitation

    Institutional rules regarding race and ethnicity in hiring can have an important influence on levels of discrimination.

    “Evidence indicates that institutional rules regarding race and ethnicity in hiring can have an important influence on levels of discrimination.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Dobbin et al. 2015 source

      The Conclusions report that special recruitment programs promote diversity, while job tests and other personnel reforms are followed by declines in diversity among disadvantaged groups. This supports the point that hiring-related rules can affect racial and ethnic outcomes, but the paper measures workforce diversity rather than levels of discrimination directly. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Interpretationcitation

    Di Stasio & Larsen (2020) found evidence of interaction between gender and race in determining hiring after taking into account interactions with minority group and share of females in occupations.

    “Finally, GEMM results reported by Di Stasio & Larsen (2020) find evidence of interaction between gender and race in determining hiring after taking into account interactions with minority group and share of females in occupations (see also Bursell 2014).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Di Stasio & Larsen (2020) source
    • cites Bursell 2014 source
  • Interpretationcitation

    There has been no change in discrimination against African Americans in the United States over the past 25 years.

    “Quillian et al. (2017) find that there has been no change over the past 25 years in discrimination against African Americans in the United States.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Quillian et al. (2017) source

      The Results report no change over the past 25 years in hiring discrimination against African Americans in the United States. The Discussion explicitly limits the findings to discrimination at the point of hire; the cited paper does not establish that discrimination more broadly was unchanged. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • Interpretationcitation

    The meta-analyses by Zschirnt & Ruedin (2016) and Quillian et al. (2019) find no statistically significant or substantively large difference in discrimination over immigrant generation groups.

    “Similarly, the meta-analyses by Zschirnt & Ruedin (2016) and Quillian et al. (2019) find no statistically significant or substantively large difference in discrimination over immigrant generation groups.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Zschirnt & Ruedin (2016) source
    • cites Quillian et al. (2019) source

      In the Results (page unavailable), Quillian et al. report that being foreign-born did not significantly predict the discrimination ratio; Table 3 (indexed under Notes, page unavailable) gives a small coefficient of −0.06. This supports a limited foreign-born versus native-born comparison, but the paper does not report a comparison across immigrant generation groups more broadly, and it cautions that low variability may explain the nonsignificant result. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • May combine two claims. 34
  • Classified as probably not a substantial claim. 15
  • May combine two claims.

    Interpretationreasoning

    The Norway inconsistency may be because the GEMM study included only private sector employers and discrimination is higher in this sector, whereas the Norwegian studies in Quillian et al. (2019) included both private and public employers.

    “This may be because the GEMM study included only private sector employers and discrimination is higher in this sector (see point 9), whereas the Norwegian studies in the meta-analysis by Quillian et al. (2019) included both private and public employers.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Quillian et al. (2019) source

      The paper’s Discussion reports a discrimination estimate for Norway, confirming that Norwegian studies were included in the meta-analysis. Our copy does not say whether those studies included both private- and public-sector employers; searches for those sector terms did not establish the claimed explanation for the difference from GEMM. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    Standard errors in meta-analysis can be calculated by building in an extra component of uncertainty because of study-level factors.

    “Second, standard errors can be calculated by building in an extra component of uncertainty because of study-level factors, a procedure used by Quillian et al. (2019) and Zschirnt & Ruedin (2016).”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Quillian et al. (2019) source
    • cites Zschirnt & Ruedin (2016) source
  • Classified as probably not a substantial claim.

    Study design and conductcitation

    Meta-regression can be used to investigate if study characteristics matter for discrimination levels by controlling factors in design.

    “First, we can directly investigate if study characteristics seem to matter for the discrimination levels the studies find by controlling factors in design in meta-regression, a procedure used by Quillian et al. (2019).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Quillian et al. (2019) source
  • May combine two claims.

    Interpretationcitation

    Discrimination against non-White groups in hiring is ubiquitous in Europe and North America, with statistically significant discrimination against every non-White group in every country except where statistical power is low.

    “1.Discrimination against non-Whites is ubiquitous.Quillian et al. (2019)find statistically significant discrimination against every non-White group in every country in Europe and North America except where statistical power is low due to few studies.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Quillian et al. (2019) source
  • May combine two claims.

    Interpretationcitation

    Quillian et al. (2019) find substantial differences over countries-in some countries Whites receive 80-100% more job offers than non-Whites, but in others they receive only 20-30% more.

    “They find substantial differences over countries-in some countries Whites receive 80-100% more job offers than non-Whites, but in others they receive only 20-30% more.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Quillian et al. (2019) source

      The Results report substantial country differences: white natives received 75–102% more callbacks in France and Sweden and 22–41% more in Germany, the United States, and Norway. This broadly supports the comparison, but the paper measures callbacks, not job offers, and its lower-discrimination range extends beyond the claimed 20–30%. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Interpretationreasoning

    Germany has a low level of discrimination in hiring, perhaps because of this distinctive practice.

    “Germany also has a low level of discrimination in hiring, perhaps because of this distinctive practice (Quillian et al. 2019, Zschirnt & Ruedin 2016).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Quillian et al. 2019 source
    • cites Zschirnt & Ruedin 2016 source
  • May combine two claims.

    Interpretationcitation

    In Germany, the level of employment discrimination is comparatively low while housing discrimination is high.

    “In Germany, for example, the level of employment discrimination is comparatively low while housing discrimination is high (e.g., contrasting country estimates from Quillian et al. 2019with Auspurg et al. 2019).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Quillian et al. 2019 source
    • cites Auspurg et al. 2019

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    A lack of data on employee race or ethnicity at both the organizational and national levels in many European countries, together with a relative lack of attention to diversity in hiring there, may be reasons that the United States has levels of hiring discrimination below those of many European countries.

    “A lack of data on employee race or ethnicity at both the organizational and national levels in many European countries, together with a relative lack of attention to diversity in hiring there, may be reasons that the United States has levels of hiring discrimination below those of many European countries (Bartkoski et al. 2018, Quillian et al. 2019).”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Bartkoski et al. 2018

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Quillian et al. 2019 source

      Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
  • May combine two claims.

    Interpretationcitation

    Koopmans et al. (2019) found both Muslim organizational participation and Black race negatively associated with callbacks, but effects were slightly larger for Black race.

    “Koopmans et al. (2019) include both membership in religious organizations on the resume and race based on appearance in a photo in a correspondence study in Germany.They find that both Muslim organizational participation and Black race were negatively associated with callbacks, but the effects were slightly larger for Black race.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Koopmans et al. (2019) source

      The Multivariate results report significantly lower positive callback for both applicants with black phenotypes and applicants volunteering for a Muslim organization. They estimate the same seven-percentage-point penalty for each, not a slightly larger effect for Black race. The Descriptive results likewise show a larger callback gap for the Muslim signal than for Black phenotype. (LLM, conf=0.92)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Tests for publication bias reported in the supplemental material of Quillian et al. (2017, 2019) find either no evidence of publication bias in field experiments on hiring discrimination or that its effects on estimates are small.

    “Tests for publication bias discussed in the supplemental material ofQuillian et al. (2017Quillian et al. ( , 2019)), however, find either no evidence of publication bias or that its effects on estimates is small.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Quillian et al. (2017 source
    • cites [2019]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    None of the meta-analysis discrimination ratios are below one, giving no evidence for reverse discrimination against White natives.

    “None of the meta-analysis discrimination ratios are below one, giving no evidence for reverse discrimination against White natives.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Counts of field experiments of racial discrimination in hiring by year show a steady pattern of increase since the 2001-2005 period, with the most studies in the period 2010-2015.

    “The table shows a steady pattern of increase since the 2001-2005 period, with the most studies in the period 2010-2015.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    More than 140 field experimental studies of hiring discrimination against ethno-racial minority groups have been conducted in 30 countries (147 distinct studies located).

    “There are more than 140 field experimental studies of hiring discrimination against ethno-racial minority groups in 30 countries.”
    • Also stated in: § INTRODUCTION · plain
      “with, to date, more than 140 studies across 30 countries focusing on hiring discrimination alone.”
    • Also stated in: § THE RISE OF FIELD EXPERIMENTS · plain
      “In total, we have to date located 147 distinct studies of racial or ethnic discrimination in hiring conducted in a total of 30 countries.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    The use of resume studies in the United States was slow to develop because US researchers had problems signaling race in a naturalistic way on a resume.

    “In the United States, the use of resume studies was slow to develop because US researchers had problems signaling race in a naturalistic way on a resume.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Quillian et al. found roughly as much discrimination after the callback as up to the callback, so discrimination in hiring from callback outcomes is approximately underestimated by a factor of two.

    “Quillian et al. find roughly as much discrimination after the callback as up to the callback, so that discrimination in hiring from callback outcomes is approximately underestimated by a factor of two.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Quillian et al. (2020b)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Auspurg et al. (2020) found that results of field experiments of racial discrimination in housing drawn from different sources change little, showing field experimental knowledge is not sensitive to sampling method in that case.

    “However, a recent study by Auspurg et al. (2020) compares results of field experiments of racial discrimination in housing drawn from different sources and finds results change little, showing that, at least in this case, field experimental knowledge is not sensitive to sampling method.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Auspurg et al. (2020)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Field experiments are usually not feasible for detecting discrimination in decisions that involve extensive and detailed knowledge or a history of contact with the target, such as internal promotions.

    “First, field experiments are usually not feasible for detecting discrimination in decisions that involve extensive and detailed knowledge or a history of contact with the target, such as internal promotions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisereasoning

    Taste and statistical discrimination are equally illegal in antidiscrimination law because it is differential treatment based on race that is illegal, regardless of motivation.

    “Finally, taste and statistical discrimination are equally illegal in antidiscrimination law-it is the differential treatment based on race that is illegal, regardless of motivation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Bertrand & Mullainathan (2004) pioneered the technique of using distinctive Black names to conduct employment tests via mail, which has become a standard method in later research.

    “The study by Bertrand & Mullainathan (2004) pioneered the technique of using distinctive Black names to conduct employment tests via mail, which has become a standard method in later research.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bertrand & Mullainathan (2004) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Recently, field experiments have increased in prevalence because of the ease of performing them online.

    “Recently, field experiments have increased in prevalence because of the ease of performing them online.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Zschirnt & Ruedin (2016) find higher discrimination in hiring in Europe than in North America, and lower discrimination in German-speaking countries than the rest of Europe.

    “Zschirnt & Ruedin (2016) group countries together and find higher discrimination in hiring in Europe than in North America, and lower discrimination in German-speaking countries than the rest of Europe.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Zschirnt & Ruedin (2016) source
  • May combine two claims.

    Interpretationcitation

    The difference in callback rates between foreign-born and domestic-born applicants is small, suggesting that minority status is more important than immigrant status in driving hiring discrimination.

    “However, the difference is small in size, suggesting that minority status is more important than immigrant status in driving hiring discrimination.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The apparent reduction in field experiments after 2015 might reflect studies that have been conducted but not yet written up.

    “The apparent reduction after 2015 might reflect studies that have been conducted but not yet written up.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The names most often used to signal race in resume audits vary in clarity as race signals and may connote other attributes like class or immigration status.

    “A fifth critique, specific to resume audits, is that the names most often used to signal race vary in clarity as race signals and may connote other attributes like class or immigration status (see Gaddis 2017a,b).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gaddis 2017a,b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Studies using the frequency of formal complaints or lawsuits alleging discrimination only capture discrimination that victims are aware of and are strongly influenced by institutional procedures that vary highly across contexts.

    “this method only captures discrimination that victims are aware of and is strongly influenced by institutional procedures that vary highly across contexts (Natl.Res.Counc.2004).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Natl.Res.Counc.2004

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    The GEMM study is the most comprehensive field experimental investigation of racial and ethnic discrimination to date, containing 53 ethnic minority groups and carried out in six countries: Germany, Norway, Spain, the Netherlands, the United Kingdom, and the United States.

    “The GEMM study is the most comprehensive field experimental investigation of racial and ethnic discrimination to date, as it contains 53 ethnic minority groups and is carried out in six countries: Germany, Norway, Spain, the Netherlands, the United Kingdom, and the United States (Lancee 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lancee 2019

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    Following formalized hiring procedures, increasing transparency about the race/ethnicity of hires, and enforcing accountability to goals that aim to increase diversity can make a difference.

    “Field experiments in this area suggest following formalized hiring procedures, increasing transparency about the race/ethnicity of hires, and enforcing accountability to goals that aim to increase diversity can make a difference (e.g., Midtbøen 2015).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Midtbøen 2015

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    These are highly racialized processes because discrimination is usually based on appearance or name without assessing the accuracy of the shadow identity.

    “These are highly racialized processes, however, because discrimination is usually based on appearance or name without assessing the accuracy of the shadow identity.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Signals of Muslim religion reduce chances of a callback, but the effect is weaker than racial origins from Islamic-majority countries.

    “A mostly consistent result emerges from these studies: Signals of Muslim religion reduce chances of a callback, but the effect is weaker than racial origins from Islamic-majority countries.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Muslims and ethnic groups from Muslim-majority countries are targets of hiring discrimination, especially in Europe.

    “11.Muslims and ethnic groups from Muslim-majority countries are discrimination targets.Evidence points toward the importance of Islam as a basis of discrimination, especially in Europe.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Information matters only when it comes from what employers view as reliable external sources, such as official certificates and outside letters of recommendation.

    “However, the self-reported nature of the information in the applications in their experiment may indicate that information matters only when it comes from what employers view as reliable external sources, such as official certificates and outside letters of recommendation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The contradictory findings suggest that both the specific target group in question and the geographical context in which field experiments are conducted play a role in whether and how race and employment status interact in shaping labor market opportunities.

    “These contradictory findings suggest that both the specific target group in question and the geographical context in which field experiments are conducted play a role in whether and how race and employment status interact in shaping labor market opportunities.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Di Stasio et al. (2019) found immigrants who disclosed participation in Muslim organizations experienced additional discrimination, although the effect was weaker than the effect of origins from Islamic-majority countries.

    “Similarly, Di Stasio et al. (2019) analyze GEMM data from five countries and find that immigrants who disclosed participation in Muslim organizations on their resume experienced additional discrimination, although the effect was weaker than the effect of origins from Islamic-majority countries.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Di Stasio et al. (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationnone given

    White ethnic minority groups experience hiring discrimination, but field experiments show they suffer from considerably less discrimination in hiring in White-majority countries than non-Whites do.

    “White ethnic minority groups experience hiring discrimination, but field experiments show they suffer from considerably less discrimination in hiring in White-majority countries than non-Whites do.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Both prejudice and stereotypical or statistical discrimination processes may operate together in producing hiring discrimination.

    “However, it is entirely possible that both prejudice and stereotypical or statistical discrimination processes operate together in producing hiring discrimination.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Widner & Chicoine (2011) found high discrimination against Arab American applicants in a US resume audit, although the estimate is highly imprecise.

    “By contrast, Widner & Chicoine (2011) find high discrimination against Arab American applicants in a US resume audit, although because the study had a small sample and low callback rate, the estimate is highly imprecise.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Widner & Chicoine (2011) source
  • May combine two claims.

    Interpretationreasoning

    Labor and housing market discrimination follow quite different patterns, suggesting that distinct factors influence the levels of each type of discrimination.

    “Labor and housing market discrimination, for instance, follow quite different patterns, suggesting that distinct factors influence the levels of each type of discrimination.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Pedulla (2018) documents substantial discrimination against African Americans, but the penalties of unemployment are weaker for Black applicants than for equally qualified White applicants.

    “This field experiment documents substantial discrimination against African Americans, but the results show that the penalties of unemployment are weaker for Black applicants than for equally qualified White applicants.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Pedulla (2018) source
  • May combine two claims.

    Interpretationcitation

    Bartkoski et al. (2018) found discrimination against Muslims but more discrimination against Arabs.

    “Conducting a formal meta-analysis of 26 field and lab experiments assessing discrimination against Muslims (with religion signaled) and Arabs (religion not signaled), Bartkoski et al. (2018) find discrimination against Muslims but more discrimination against Arabs.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Bartkoski et al. (2018)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The lower discrimination in the public sector may be due in part to more formalized procedures in the public sector.

    “This may in part be due to more formalized procedures in the public sector-similar to common explanations of the size result discussed above.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Zschirnt & Ruedin (2016) found more discrimination in hiring when country unemployment is very high but little correlation of discrimination and unemployment overall.

    “The meta-analysis by Zschirnt & Ruedin (2016), in contrast, finds more discrimination in hiring when country unemployment is very high but little correlation of discrimination and unemployment overall.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Zschirnt & Ruedin (2016) source
  • May combine two claims.

    Interpretationcitation

    Birkelund et al. (2016) found an additive pattern of discrimination in Norway: majority applicants without an unemployment gap in their resumes have the highest callback rates, while unemployed applicants with Pakistani names have the lowest.

    “In Norway, Birkelund et al. (2016) find such an additive pattern of discrimination; majority applicants without an unemployment gap in their resumes have the highest callback rates, while unemployed applicants with Pakistani names have the lowest.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Birkelund et al. (2016)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    The potential trade-off is that soliciting more job-relevant information would damage the job prospects of those whose backgrounds, based on the additional information, are not employment enhancing, with the danger of creating trapped groups.

    “The potential trade-off is that this would damage the job prospects of those whose backgrounds, based on the additional information, are not employment enhancing-with the danger (as may occur to ex-felons) of creating trapped groups who combine multiple forms of identities that have great difficulty gaining employment because of their background.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Studies of racism and studies of discrimination have been highly separate.

    “Finally, studies of racism and studies of discrimination have been highly separate.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    There are only a few field experiments of racial discrimination outside of North America, Europe, and Australia.

    “There are only a few field experiments of racial discrimination outside of North America, Europe, and Australia.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Designing recruitment processes to solicit more job-relevant information on applicants at the point of initial application could reduce discrimination.

    “Under the right circumstances, designing recruitment processes to solicit more job-relevant information on applicants at the point of initial application could also be a route to reducing discrimination-in some ways, this would make application procedures and links to education more like those in German-speaking countries.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    In the United States and United Kingdom, discrimination has hardly diminished over the past 25 years.

    “In the United States and United Kingdom, discrimination has hardly diminished over the past 25 years.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Transparency in the racial composition of employees and managers may be an important tool to help control discrimination in hiring.

    “Just as the literature suggests salary transparency is a factor that can help control inequalities in earnings (e.g., Castilla 2015), transparency in the racial composition of employees and managers may be an important tool to help control discrimination in hiring.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Castilla 2015 source
48 of 48

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Same study placed in two countries

    Minor

    The paper places the Baert et al. (2015) study of high-demand occupations in the Netherlands in one passage and in Belgium in another.

  • Callback-outcome studies described inconsistently

    Minor

    The first statement says experiments without callback outcomes underestimate discrimination by omitting post-callback discrimination. The following statement instead identifies estimates based on callback outcomes as the ones that omit post-callback discrimination.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 26

  1. Allport G., 1979, The Nature of Prejudice
  2. Auspurg K, 2020, Res. Soc. Strat. Mobil.
  3. Bartkoski T, 2018, Pers. Assess. Decis., 4, 1
  4. 10.3386/w22014 · DOI
  5. Biondi M., 2003, To Stand and Fight
  6. Birkelund GE, 2016, Eur. Sociol. Rev., 33, 17
  7. Bovenkerk F, 1979, Problems in International Comparative Research in the Social Sciences, 105
  8. Crenshaw K., 1989, Univ. Chicago Leg. Forum, 1, 8
  9. Di Stasio V, 2020, Res. Soc. Strat. Mobil., 64, 100463
  10. Di Stasio V, 2019, J. Ethn. Migr. Stud.
  11. FRA (Eur. Union Agency Fundam. Rights), 2008, Annual Report 2008
  12. Galgano SW., 2009, Soc. Thought Res., 30, 21
  13. Heath A, 2013, OECD International Migration Outlook 2013, 191
  14. Hirsh E, 2020, What Works? Evidence-Based Ideas to Increase Diversity, Equity, and Inclusion in the Workplace, 16
  15. Jolson MA., 1974, J. Mark., 38, 67
  16. Kirschenman J, 1991, The Urban Underclass, 203
  17. Lancee B., 2019, J. Ethn. Migr. Stud.
  18. Majors S., 2020, Washington Post
  19. Neumark D., 2012, J. Hum. Resourc., 47, 1128
  20. Oreopoulos P., 2011, Am. Econ. J., 3, 148
  21. Phelps ES., 1972, Am. Econ. Rev., 62, 659
  22. Raveau F, 1976, Cah. Anthropol., 1, 23
  23. Smith DJ., 2015, The Guardian
  24. Thijssen L, 2019, J. Ethn. Migr. Stud.
  25. Wienk RE, 1979, Measuring Discrimination in American Housing Markets: The Housing Market Practices Survey
  26. Wood M, 2009, A test for racial discrimination in recruitment practice in British cities

Cited by

Sorted by citations

Authors
Quillian, L., & Midtbøen, A. H.
Affiliations
  • Northwestern University (US)
  • University of Oslo (NO)
Venue
Annual Review of Sociology
Published
2021-07-31
Volume
47
Issue
1
Pages
391-415
ISSN
  • 0360-0572 (ISSN-L)
  • 1545-2115
OpenAlex
W3157931011
Cited by
180
References
129
Citations by year
2026: 19 · 2025: 48 · 2024: 46 · 2023: 29 · 2022: 33 · 2021: 5
FWCI
5.43
Type
journal article
Language
en
Open access
Locations
  • Annual Review of Sociology (publishedVersion)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
Funders
  • Sage Foundation
  • John Simon Guggenheim Memorial Foundation
Topics
  • Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
  • Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
  • Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
Keywords
racial discrimination in hiring, ethnic minorities, field experiments, cross-national comparison, racist ideology, employer decision-making

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-04.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-04.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review