The DOI matches its Crossref record; 442 of the 442 references it cites were found in a registry or an index.
A multidisciplinary survey on discrimination analysis
Abstract
The collection and analysis of observational and experimental data represent the main tools for assessing the presence, the extent, the nature, and the trend of discrimination phenomena. Data analysis techniques have been proposed in the last 50 years in the economic, legal, statistical, and, recently, in the data mining literature. This is not surprising, since discrimination analysis is a multidisciplinary problem, involving sociological causes, legal argumentations, economic models, statistical techniques, and computational issues. The objective of this survey is to provide a guidance and a glue for researchers and anti-discrimination data analysts on concepts, problems, application areas, datasets, methods, and approaches from a multidisciplinary perspective. We organize the approaches according to their method of data collection as observational, quasi-experimental, and experimental studies. A fourth line of recently blooming research on knowledge discovery based methods is also covered. Observational methods are further categorized on the basis of their application context: labor economics, social profiling, consumer markets, and others.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the machine learning field has seen an explosion of research on fairness.”
From The Discriminating (Pricing) Actuary (2023) · cites this paper as Romei and Ruggieri (2014)
In the citing paper
“This literature provides discussions and debates on how to define fairness of predictive models and how to measure the performance in terms of discrimination.”
From The Discriminating (Pricing) Actuary (2023) · cites this paper as Romei and Ruggieri (2014)
In the citing paper
“Not considering correlated variables has been shown to increase the risk of discrimination (e.g., redlining 4 ) [54,88,89,89,196,202,231,247,286,308].”
From Fairness in machine learning: A survey (2024) · cites this paper as [247]
In the citing paper
“There is also the risk of redlining, where although the sensitive attribute is łhandledž suiciently, correlated variables are still present [54,89,231,247,286,308], amplifying instead of reducing unfairness [89].”
From Fairness in machine learning: A survey (2024) · cites this paper as [247]
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,279
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 9,020
Male-female wage differentials in urban labor markets
Oaxaca, R. (1973) · International Economic Review · doi:10.2307/2525981 · Cited by 8,463
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,453
Research works printed but not linked: 26
- Ghosh, 2000, Hierarchical Bayesian analysis of binary matched data, Statistica Sinica, 10, 647
- Armstrong, 2006, Proceedings of World Congress on Advances in Economics and Econometrics Theory and Applications, 1
- Gastwirth, 1992, Methods for assessing the sensitivity of statistical comparisons used in Title VII cases to omitted variables, Jurimetrics Journal, 33, 19
- Ding, 2008, Neighborhood patterns of high-cost lending: the case of Atlanta, Journal of Affordable Housing, 17, 194
- Clifton C. 2003. Privacy preserving data mining: How do we mine data when we aren't allowed to see it? In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2003), Tutorial, Washington, DC, USA. http://www.cs.purdue.edu.
- Charness, 2011, Handbook of Labor Economics, 229, 10.1016/S0169-7218(11)00409-6 · DOI
- Blank, 2004, Measuring Racial Discrimination – Panel on Methods for Assessing Discrimination
- Fix, 1999, A National Report Card on Discrimination in America: The Role of Testing
- 2007, Science, Technology and Gender: An International Report
- Heckman, 1993, Clear and Convincing Evidence: Measures of discrimination in America, 187
- Greene, 2008, Econometric Analysis
- Hoeting, 1999, Bayesian model averaging: a tutorial, Statistical Science, 14, 382
- Ross, 1999, Mortgage lending discrimination: A review of existing evidence, 107
- Paetzold, 1994, The Statistics of Discrimination: Using Statistical Evidence in Discrimination Cases
- Körffer, 2008, Profiling the European Citizen: Cross-Disciplinary Perspectives, 201
- 10.1023/A:1008616203852 · DOI
- Leopold, 2008, Profiling the European Citizen: Cross-Disciplinary Perspectives, 236
- Scheinkman, 2008, The New Palgrave Dictionary of Economics
- Longhofer, 1999, Why is mortgage discrimination illegal? A fresh look at the mortgage discrimination debate, Regulation, Cato Institute, 22, 28
- Fienberg, 1995, Understanding and evaluating statistical evidence in litigation, Jurimetrics Journal of Law, Science, and Technology, 36, 1
- Lee, 2009, American Idol: evidence on same-race preferences, The Berkeley Electronic Journal of Economic Analysis and Policy, 9
- 10.1353/jhr.2011.0025 · DOI
- Rachlis, 1993, Serious flaws in statistical tests for discrimination in mortgage markets, Journal of Housing Research, 2, 315
- Ross, 1997, Mortgage lending discrimination and racial differences in loan default: a simulation approach, Journal of Housing Research, 8, 277
- Ellis, 2005, EU Anti-Discrimination Law
- Shoben, 1992, Statistical Methods in Discrimination Litigation, 55
Cited by
Sorted by citations
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
“However, proxies for protected attributes are not easy to predict or detect (Romei and Ruggieri, 2014; Zarsky, 2016), particularly when algorithms access linked datasets (Barocas and Selbst, 2015).”
InfluentialFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Metadata
- Authors
- Romei, A., & Ruggieri, S.
- Affiliations
- University of Pisa (IT)
- Venue
- The Knowledge Engineering Review
- Publisher
- Maximum Academic Press
- Published
- 2013-04-03
- Volume
- 29
- Issue
- 5
- Pages
- 582-638
- ISSN
- 0269-8889 (ISSN-L)
- 1469-8005
- OpenAlex
- W2166454173
- Semantic Scholar
- b0d3968e7a630d3661cd0878acc38c85f1828a9c
- Cited by
- 288
- References
- 442
- Citations by year
- 2026: 4 · 2025: 18 · 2024: 21 · 2023: 31 · 2022: 27 · 2021: 33 · 2020: 23 · 2019: 38 · 2018: 31 · 2017: 28 · 2016: 17 · 2015: 9 · 2014: 5 · 2013: 3
- FWCI
- 29.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Knowledge Engineering Review (publishedVersion)
- UnipiEprints Open Archive (Università di Pisa) (acceptedVersion)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion)
- ISTI Open Portal (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Law › Discrimination and Equality Law
- Keywords
- discrimination analysis, anti-discrimination, observational studies, quasi-experimental design, experimental study, knowledge discovery, labor economics, social profiling, consumer market
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
