The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Different samples, different results? How sampling techniques affect the results of field experiments on ethnic discrimination
Abstract
Abstract This paper explores a possible sampling bias in field experiments through a unique combination of a large-scale field experiment on ethnic discrimination in the German rental housing market (N = 2,992 tested apartments) and data on the internet housing market where the apartments were sampled from (observation of the whole platform for about one year). Up to now, most field experiments sampled on the level of suppliers (not apartments) and selected the tested suppliers within a short field period (point sampling). This probably led to an over-representation of small suppliers and apartments that had already been advertised for a long time, resulting in an under-representation of large suppliers and new vacancies. We analyze how both issues affect the measurement of ethnic discrimination and its underlying mechanisms. With our case study on the German housing market, we first observed the expected sampling bias: There was a strong over-sampling of small suppliers and apartments already offered for a long time. Second, this bias was found to have only little impact on the descriptive result of substantial discrimination against Turkish applicants. There was only a slight tendency that discrimination was higher for small suppliers and offers advertised for a relatively short time (i.e. new vacancies). Overall, we conclude that evidence on ethnic discrimination and its underlying risk factors is remarkably robust to the used sampling technique. Although there were no indications of a severe bias, our market data illustrate opportunities to test the effects of market conditions that often remained unnoticed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, a recent study by Auspurg et al. (2020) compares results of field experiments of racial discrimination in housing drawn from different sources and finds results change little, showing that, at least in this case, field experimental knowledge is not sensitive to sampling method.”
From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Auspurg et al. (2020)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
(2002) · Cited by 13,211
Robust Locally Weighted Regression and Smoothing Scatterplots
Cleveland, W. S. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481038 · Cited by 11,594
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
The Economics of Discrimination.
Collard, D. A., & Becker, G. S. (1972) · The Economic Journal · doi:10.2307/2230052 · Cited by 3,648
The Statistical Theory of Racism and Sexism.
Phelps, E. S. (1972) · American Economic Review · Cited by 3,412
Pager, D., & Shepherd, H. (2008) · Annual Review of Sociology · doi:10.1146/annurev.soc.33.040406.131740 · Cited by 2,064
Arrow, K. J. (2015) · Princeton University Press eBooks · doi:10.1515/9781400867066-003 · Cited by 1,897
Computing Interaction Effects and Standard Errors in Logit and Probit Models
Norton, E. C., Wang, H., & Ai, C. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400206 · Cited by 1,761
Statistical Theories of Discrimination in Labor Markets
Aigner, D. J., & Cain, G. G. (1977) · ILR Review · doi:10.1177/001979397703000204 · Cited by 1,503
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168
Handbook of Research Methods in Social and Personality Psychology: Author Index
Reis, H. T., & Judd, C. M. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481 · Cited by 1,080
Field Experiments on Discrimination
(2017) · Handbook of Economic Field Experiments · doi:10.1016/bs.hefe.2016.08.004 · Cited by 910
Auspurg, K., & Hinz, T. (2015) · Sage eBooks · doi:10.4135/9781483398075 · Cited by 826
Self-citationHeckman, J. J. (1998) · Journal of Economic Perspectives · doi:10.1257/jep.12.2.101 · Cited by 824
What Has Economics to Say About Racial Discrimination?
Arrow, K. J. (1998) · Journal of Economic Perspectives · doi:10.1257/jep.12.2.91 · Cited by 679
The Economics of Discrimination.
Alchian, A. A., & Becker, G. (1958) · Journal of the American Statistical Association · doi:10.2307/2281986 · Cited by 674
New Approaches to Understanding Racial Prejudice and Discrimination
Quillian, L. (2006) · Annual Review of Sociology · doi:10.1146/annurev.soc.32.061604.123132 · Cited by 605
Bertrand, M., Chugh, D., & Mullainathan, S. (2005) · American Economic Review · doi:10.1257/000282805774670365 · Cited by 594
Discrimination in Labor Markets.
Stoikov, V., Ashenfelter, O., & Rees, A. (1975) · Industrial and Labor Relations Review · doi:10.2307/2521858 · Cited by 548
Research Design and Issues of Validity
Brewer, M. B., & Crano, W. D. (2014) · Handbook of Research Methods in Social and Personality Psychology · doi:10.1017/cbo9780511996481.005 · Cited by 522
Bit by Bit: Social Research in the Digital Age
King, T. (2018) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12375 · Cited by 421
MEASURING RACIAL DISCRIMINATION WITH FAIR HOUSING AUDITS: CAUGHT IN THE ACT
(2018) · Housing and Commuting: The Theory of Urban Residential Structure · doi:10.1142/9789813206670_0025 · Cited by 384
Plotting Regression Coefficients and other Estimates
Jann, B. (2014) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1401400402 · Cited by 379
Housing Discrimination in Metropolitan America: Explaining Changes between 1989 and 2000
ROSS, S. L., & TURNER, M. A. (2005) · Social Problems · doi:10.1525/sp.2005.52.2.152 · Cited by 297
Bit by Bit: Social Research in the Digital Age
Elgesem, D. (2020) · European Journal of Communication · doi:10.1177/0267323120922090 · Cited by 284
Statistical Discrimination or Prejudice? A Large Sample Field Experiment
Ewens, M., Tomlin, B., & Wang, L. C. (2013) · The Review of Economics and Statistics · doi:10.1162/rest_a_00365 · Cited by 268
Is There Less Discrimination in Occupations Where Recruitment Is Difficult?
Baert, S., Cockx, B., Gheyle, N., & Vandamme, C. (2015) · ILR Review · doi:10.1177/0019793915570873 · Cited by 243
Detecting Discrimination in Audit and Correspondence Studies
Neumark, D. (2012) · The Journal of Human Resources · doi:10.3368/jhr.47.4.1128 · Cited by 243
Auspurg, K., Schneck, A., & Hinz, T. (2018) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2018.1489223 · Cited by 234
Self-citationInformation and discrimination in the rental housing market: Evidence from a field experiment
Bosch, M., Carnero, M. A., & Farré, L. (2010) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2009.11.001 · Cited by 202
Sex Discrimination and Product Market Competition: The Case of the Banking Industry
Ashenfelter, O., & Hannan, T. H. (1986) · The Quarterly Journal of Economics · doi:10.2307/1884646 · Cited by 185
Flage, A. (2018) · Journal of Housing Economics · doi:10.1016/j.jhe.2018.07.003 · Cited by 183
Ahmed, A. M., Andersson, L., & Hammarstedt, M. (2009) · Land Economics · doi:10.3368/le.86.1.79 · Cited by 164
Ethnic discrimination in the Italian rental housing market
Baldini, M., & Federici, M. (2011) · Journal of Housing Economics · doi:10.1016/j.jhe.2011.02.003 · Cited by 155
Deceptive Field Experiments of Discrimination: Are they Ethical?
Riach, P. A., & Rich, J. (2004) · Kyklos · doi:10.1111/j.0023-5962.2004.00262.x · Cited by 148
Market Forces and Sex Discrimination
Hellerstein, J. K., Neumark, D., & Troske, K. R. (1997) · National Bureau of Economic Research · doi:10.3386/w6321 · Cited by 148
Market Forces and Sex Discrimination
Hellerstein, J. K., Neumark, D., & Troske, K. R. (2002) · The Journal of Human Resources · doi:10.2307/3069651 · Cited by 135
Racial and Ethnic Biases in Rental Housing: An Audit Study of Online Apartment Listings
Hogan, B., & Berry, B. M. (2011) · City and Community · doi:10.1111/j.1540-6040.2011.01376.x · Cited by 131
Auspurg, K., Hinz, T., & Schmid, L. (2017) · Journal of Housing Economics · doi:10.1016/j.jhe.2017.01.003 · Cited by 130
Self-citationMeasuring Racial Discrimination with Fair Housing Audits: Caught in the Act
Yinger, J. (1986) · RePEc: Research Papers in Economics · Cited by 130
Research on discrimination in housing and mortgage markets: Assessment and future directions
Galster, G. (1992) · Housing Policy Debate · doi:10.1080/10511482.1992.9521105 · Cited by 116
Discrimination in the rental market for apartments
Carlsson, M., & Eriksson, S. (2013) · Journal of Housing Economics · doi:10.1016/j.jhe.2013.11.004 · Cited by 116
A Field Experiment of Discrimination in the Norwegian Housing Market: Gender, Class, and Ethnicity
Andersson, L., Jakobsson, N., & Kotsadam, A. (2012) · Land Economics · doi:10.3368/le.88.2.233 · Cited by 109
Cycle of Segregation: Social Processes and Residential Stratification
Argeros, G. (2018) · Sociology of Race and Ethnicity · doi:10.1177/2332649218774565 · Cited by 103
Mortgage lending, racial discrimination, and federal policy
(1997) · Choice Reviews Online · doi:10.5860/choice.34-4595 · Cited by 97
A field study of rental market discrimination across origins in France
Acolin, A., Bostic, R., & Painter, G. (2016) · Journal of Urban Economics · doi:10.1016/j.jue.2016.07.003 · Cited by 92
Field Experiment Tests for Discrimination against Hispanics in the U.S. Rental Housing Market
Hanson, A., & Santas, M. (2014) · Southern Economic Journal · doi:10.4284/0038-4038-2012.231 · Cited by 87
Sand Castles Before the Tide? Affordable Housing in Expensive Cities
Metcalf, G. (2018) · The Journal of Economic Perspectives · doi:10.1257/jep.32.1.59 · Cited by 81
Hanson, A., Hawley, Z. B., & Taylor, A. (2011) · Journal of Housing Economics · doi:10.1016/j.jhe.2011.09.003 · Cited by 77
Gender and ethnic discrimination in the rental housing market
Bengtsson, R., Iverman, E., & Hinnerich, B. T. (2011) · Applied Economics Letters · doi:10.1080/13504851.2011.564125 · Cited by 73
Wage discrimination over the business cycle
Biddle, J. E., & Hamermesh, D. S. (2013) · IZA Journal of Labor Policy · doi:10.1186/2193-9004-2-7 · Cited by 65
Discrimination and selection in the Belgian private rental market
Heylen, K., & den Broeck, K. V. (2015) · Housing Studies · doi:10.1080/02673037.2015.1070798 · Cited by 60
Cycle of Segregation: Social Processes and Residential Stratification
Krysan, M., & Crowder, K. D. (2017) · Cited by 60
Turner, M. A., Ross, S. L., Galster, G., et al. (2002) · RePEc: Research Papers in Economics · Cited by 59
Survival analysis under cross-sectional sampling: length bias and multiplicative censoring
van Es, B., Klaassen, C. A. J., & Groothuis‐Oudshoorn, C. G. M. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00183-x · Cited by 56
Statistical Power in Experimental Audit Studies
Vuolo, M., Uggen, C., & Lageson, S. E. (2015) · Sociological Methods & Research · doi:10.1177/0049124115570066 · Cited by 49
Rental housing discrimination across protected classes: Evidence from a randomized experiment
Murchie, J. E., & Pang, J. (2018) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2018.10.003 · Cited by 47
Ethnic and gender discrimination in the private rental housing market in Finland: A field experiment
Öblom, A., & Antfolk, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0183344 · Cited by 44
Auspurg, K., Brüderl, J., & Wöhler, T. (2019) · American Sociological Review · doi:10.1177/0003122419856347 · Cited by 41
Self-citationGaining Access to Housing in Germany: The Foreign-minority Experience
Drever, A. I., & Clark, W. A. V. (2002) · Urban Studies · doi:10.1080/0042098022000027040 · Cited by 39
Rental housing discrimination and the persistence of ethnic enclaves
Bosch, M., Carnero, M. A., & Farré, L. (2015) · SERIEs · doi:10.1007/s13209-015-0122-5 · Cited by 39
The Effects of Multiple Stigmas on Discrimination in the German Housing Market
Mazziotta, A., Zerr, M., & Rohmann, A. (2015) · Social Psychology · doi:10.1027/1864-9335/a000249 · Cited by 38
Housing provision in 21st century Europe
Ball, M. J. (2015) · Habitat International · doi:10.1016/j.habitatint.2015.11.024 · Cited by 33
Do Employers Discriminate Less if Vacancies are Difficult to Fill? Evidence from a Field ExperimentPreprint
Baert, S., Cockx, B. L. W., Gheyle, N., & Vandamme, C. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2214896 · Cited by 27
Do Employers Discriminate Less If Vacancies are Difficult to Fill? Evidence from a Field ExperimentPreprint
Baert, S., Cockx, B. L. W., Gheyle, N., & Vandamme, C. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2207286 · Cited by 25
Ethnic Discrimination in the Rental Housing Market: An Experiment in New Caledonia
Bunel, M., Gorohouna, S., L’Horty, Y., Petit, P., & Ris, C. (2017) · International Regional Science Review · doi:10.1177/0160017617739065 · Cited by 23
European Monitoring Centre for Racism and Xenophobia
Rose, S. (2014) · European Union regulations | European Encyclopedia of law · Cited by 16
On the “Where” of Social Experiments: The Nature and Extent of the Generalizability Problem
Bell, S. H., & Stuart, E. A. (2016) · New Directions for Evaluation · doi:10.1002/ev.20212 · Cited by 11
Björnsson, D. F., Kopsch, F., & Zoëga, G. (2018) · Journal of International Migration and Integration / Revue de l integration et de la migration internationale · doi:10.1007/s12134-018-0574-0 · Cited by 11
Research works printed but not linked: 2
- Fernandez, 2014, Does competition drive out discrimination?, Paper presented at the annual meeting of the American Sociological Association
- Pager, 2008, The sociology of discrimination: Racial discrimination in employment, housing, credit, and consumer markets, Annual Review of Sociology, 34, 181, 10.1146/annurev.soc.33.040406.131740 · DOI · Paper page
Cited by
Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments
Quillian, L., & Midtbøen, A. H. (2021) · Annual Review of Sociology · doi:10.1146/annurev-soc-090420-035144 · Cited by 180
Verhaeghe, P.-P. (2022) · Handbook of Labor, Human Resources and Population Economics · doi:10.1007/978-3-319-57365-6_306-1 · Cited by 33
Metadata
- Authors
- Auspurg, K., Schneck, A., & Thiel, F.
- Venue
- Research in Social Stratification and Mobility
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 65
- Pages
- 100444
- ISSN
- 0276-5624
- Cited by
- 14
- References
- 72
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- Wolfgang and Anita Bürkle foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.