An Introduction to Audit Studies in the Social Sciences
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Correspondence audits allow manipulation of a wider range of variables and are less subject to confederate bias and confounds than in-person audit studies, while allowing strong causal claims.
“Correspondence audits allow for the manipulation of a wider range of variables and are less subject to confederate bias and confounds than are in-person audit studies, while allowing for strong causal claims (Gaddis 2018).”
From Prejudice and Discrimination Toward Immigrants (2021) · cites this paper as Gaddis 2018
The decomposition method sketches an incomplete picture of discrimination.
“The decomposition method thus sketches an incomplete picture of discrimination (Borjas, 2020;Gaddis, 2018).”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Gaddis, 2018
Cites
Pager, D. (2003) · American Journal of Sociology · doi:10.1086/374403 · Cited by 2,840 · see citing works
Discrimination in a Low-Wage Labor Market: A Field Experiment
Pager, D., Bonikowski, B., & Western, B. (2009) · American Sociological Review · doi:10.1177/000312240907400505 · Cited by 1,022 · see citing works
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887 · see citing works
Ethnic Discrimination in Germany’s Labour Market: A Field Experiment
Kaas, L., & Manger, C. (2012) · German Economic Review · doi:10.1111/j.1468-0475.2011.00538.x · Cited by 509 · see citing works
Automatic associations and discrimination in hiring: Real world evidence
Rooth, D.-O. (2010) · Labour Economics · doi:10.1016/j.labeco.2009.04.005 · Cited by 413 · see citing works
MICHELITCH, K. (2015) · American Political Science Review · doi:10.1017/s0003055414000628 · Cited by 186 · see citing works
No Foot in the Door: An Experimental Study of Employment Discrimination Against Older Workers
Bendick, M., Brown, L. E., & Wall, K. (1999) · Journal of Aging & Social Policy · doi:10.1300/j031v10n04_02 · Cited by 159 · see citing works
Ethnic discrimination in the Italian rental housing market
Baldini, M., & Federici, M. (2011) · Journal of Housing Economics · doi:10.1016/j.jhe.2011.02.003 · Cited by 155 · see citing works
Rich, J. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2517887 · Cited by 134 · see citing works
Experimental Evidence of Discrimination in the Hiring of First‐ and Second‐generation Immigrants
Carlsson, M. (2010) · LABOUR · doi:10.1111/j.1467-9914.2010.00482.x · Cited by 125 · see citing works
Field Experiment Tests for Discrimination against Hispanics in the U.S. Rental Housing Market
Hanson, A., & Santas, M. (2014) · Southern Economic Journal · doi:10.4284/0038-4038-2012.231 · Cited by 87 · see citing works
Pierné, G. (2013) · IZA Journal of Labor Economics · doi:10.1186/2193-8997-2-4 · Cited by 81 · see citing works
Discrimination against latino job applicants: A controlled experiment
Bendick, M., Jackson, C. W., Reinoso, V. A., & Hodges, L. E. (1991) · Human Resource Management · doi:10.1002/hrm.3930300404 · Cited by 80 · see citing works
Van der Bracht, K., Coenen, A., & Van de Putte, B. (2015) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2014.913476 · Cited by 79 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Using large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369 · see citing works
Prejudice and Discrimination Toward Immigrants
Esses, V. M. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-080520-102803 · Cited by 273 · see citing works
Evaluating and Mitigating Discrimination in Language Model Decisions
Tamkin, A., Askell, A., Lovitt, L., Durmus, E., Joseph, N., Kravec, S., Nguyen, K., Kaplan, J., & Ganguli, D. (2023) · arXiv · doi:10.48550/arxiv.2312.03689 · Cited by 11 · see citing works
“The gold standard for investigating this question would be to analyze language model decisions in specific real-world applications, following the rich tradition of audit studies in the social sciences (Jowell & Prescott-Clarke, 1970; Gaddis, 2018).”
BackgroundInfluentialLippens, L., Vermeiren, S., & Baert, S. (2023) · European Economic Review · doi:10.1016/j.euroecorev.2022.104315
- Authors
- Gaddis, S. M.
- Affiliations
- University of California, Los Angeles (US)
- Corresponding author
- Gaddis, S. Michael
- ORCID
- Gaddis, S. Michael
- Venue
- Audit Studies: Behind the Scenes with Theory, Method, and Nuance
- Publisher
- Springer International Publishing
- Published
- 2018
- Pages
- 3-44
- OpenAlex
- W2770914390
- Cited by
- 157
- References
- 14
- Citations by year
- 2026: 6 · 2025: 14 · 2024: 22 · 2023: 31 · 2022: 23 · 2021: 21 · 2020: 15 · 2019: 15 · 2018: 8 · 2017: 2
- FWCI
- 82.49
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Springer eBooks (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- audit studies, correspondence audit, discriminatory behavior, social desirability bias, field experiments, discrimination measurement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review