Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 310

The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.

Inherent Tradeoffs in the Fair Determination of Risk Scores

·2023·The Societal Impacts of Algorithmic Decision-Making
DOI 10.1145/3603195.3603197
Open this paper in CoChat — free account

Abstract

chapter Share on Inherent Tradeoffs in the Fair Determination of Risk Scores Author: Manish Raghavan Massachusetts Institute of Technology, Sloan School of Management and Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology, Sloan School of Management and Department of Electrical Engineering and Computer ScienceView Profile Authors Info & Claims The Societal Impacts of Algorithmic Decision-MakingSeptember 2023https://doi.org/10.1145/3603195.3603197Published:08 September 2023Publication History 0citation0DownloadsMetricsTotal Citations0Total Downloads0Last 12 Months0Last 6 weeks0 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Publisher SiteGet Access

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3603195.3603197

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 56 references

Research works printed but not linked: 263

  1. Y. Abbasi-Yadkori , D. Pál , and C. Szepesvári . 2011. Improved algorithms for linear stochastic bandits . In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , Vol. 24 . Curran Associates. Retrieved from https://proceedings.neurips.cc/paper_files/paper/ 2011 /file/e1d5be1c7f2f456670de3d53c7b54f4a-Paper.pdf. Y. Abbasi-Yadkori, D. Pál, and C. Szepesvári. 2011. Improved algorithms for linear stochastic bandits. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Vol. 24. Curran Associates. Retrieved from https://proceedings.neurips.cc/paper_files/paper/2011/file/e1d5be1c7f2f456670de3d53c7b54f4a-Paper.pdf.
  2. 10.1145/3351095.3372871 · DOI · Paper page
  3. A. Agarwal , D. Hsu , S. Kale , J. Langford , L. Li , and R. Schapire . 2014. Taming the monster: A fast and simple algorithm for contextual bandits . In Proceedings of the 31st International Conference on Machine Learning (ICML) , Vol. 32 . PMLR, 1638–1646. https://proceedings.mlr.press/v32/agarwalb14.html. A. Agarwal, D. Hsu, S. Kale, J. Langford, L. Li, and R. Schapire. 2014. Taming the monster: A fast and simple algorithm for contextual bandits. In Proceedings of the 31st International Conference on Machine Learning (ICML), Vol. 32. PMLR, 1638–1646. https://proceedings.mlr.press/v32/agarwalb14.html.
  4. 10.48550/arXiv.1606.03966 · DOI
  5. 10.2139/ssrn.2746078 · DOI · Paper page
  6. 10.1609/aaai.v34i02.5543 · DOI
  7. 10.1111/j.1467-937X.2007.00471.x · DOI · Paper page
  8. J. Angwin and J. Larson. 2022. Bias in criminal risk scores is mathematically inevitable researchers say. Ethics of Data and Analytics. Auerbach Publications 265–267. J. Angwin and J. Larson. 2022. Bias in criminal risk scores is mathematically inevitable researchers say. Ethics of Data and Analytics . Auerbach Publications 265–267. · DOI
  9. J. Angwin J. Larson S. Mattu and L. Kirchner. 2022. Machine bias. Ethics of Data and Analytics. Auerbach Publications 254–264. J. Angwin J. Larson S. Mattu and L. Kirchner. 2022. Machine bias. Ethics of Data and Analytics . Auerbach Publications 254–264. · DOI · Paper page
  10. K. J. Arrow . 1963 . Uncertainty and the welfare economics of medical care . Am. Econ. Rev. 53 , 5, 941 – 973 . http://www.jstor.org/stable/1812044. K. J. Arrow. 1963. Uncertainty and the welfare economics of medical care. Am. Econ. Rev. 53, 5, 941–973. http://www.jstor.org/stable/1812044.
  11. K. J. Arrow . 1968 . The economics of moral hazard: Further comment . Am. Econ. Rev. 58 , 3, 537 – 539 . http://www.jstor.org/stable/1813786. K. J. Arrow. 1968. The economics of moral hazard: Further comment. Am. Econ. Rev. 58, 3, 537–539. http://www.jstor.org/stable/1813786.
  12. P. Auer . 2002 . Using confidence bounds for exploitation–exploration trade-offs . J. Mach. Learn. Res. 3 , 397 – 422 . P. Auer. 2002. Using confidence bounds for exploitation–exploration trade-offs. J. Mach. Learn. Res. 3, 397–422.
  13. H. Azari Soufiani , D. C. Parkes , and L. Xia . 2012. Random utility theory for social choice . In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS’12) . Curran Associates, 126–134. H. Azari Soufiani, D. C. Parkes, and L. Xia. 2012. Random utility theory for social choice. In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS’12). Curran Associates, 126–134.
  14. H. Azari Soufiani , H. Diao , Z. Lai , and D. C. Parkes . 2013. Generalized random utility models with multiple types . In Proceedings of the Advances in Neural Information Processing Systems (NIPS 2013 ), Vol. 26 . Curran Associates, 73–81. H. Azari Soufiani, H. Diao, Z. Lai, and D. C. Parkes. 2013. Generalized random utility models with multiple types. In Proceedings of the Advances in Neural Information Processing Systems (NIPS 2013), Vol. 26. Curran Associates, 73–81.
  15. J. M. Balkin . 2015 . Information fiduciaries and the First Amendment . Univ. Calif. Davis Law Rev. 49 , 1183 – 1234 . J. M. Balkin. 2015. Information fiduciaries and the First Amendment. Univ. Calif. Davis Law Rev. 49, 1183–1234.
  16. 10.48550/arXiv.1909.01888 · arXiv · doi:10.48550/arxiv.1909.01888
  17. J. Bambauer and T. Zarsky . 2018 . The algorithm game . Notre Dame Law Rev. 94 , 1, 1 – 48 . J. Bambauer and T. Zarsky. 2018. The algorithm game. Notre Dame Law Rev. 94, 1, 1–48.
  18. L. Baritz . 1960. The Servants of Power: A History of the Use of Social Science in American Industry . Wesleyan University Press . L. Baritz. 1960. The Servants of Power: A History of the Use of Social Science in American Industry. Wesleyan University Press.
  19. 10.1145/3351095.3372830 · DOI · Paper page
  20. 10.1177/1529100619832930 · DOI · Paper page
  21. 10.1287/mnsc.2020.3605 · DOI
  22. Y. Bechavod , C. Jung , and Z. S. Wu . 2020. Metric-free individual fairness in online learning . In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS’20) . Curran Associates, 11214–11225. Y. Bechavod, C. Jung, and Z. S. Wu. 2020. Metric-free individual fairness in online learning. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS’20). Curran Associates, 11214–11225.
  23. 10.3138/jsp.41.2.176 · DOI · Paper page
  24. 10.1111/j.1540-4560.2012.01747.x · DOI
  25. 10.1300/j031v08n04_03 · DOI
  26. J. R. Bent . 2020 . Is algorithmic affirmative action legal ? Georgetown Law J. 108 , 4 , 803. J. R. Bent. 2020. Is algorithmic affirmative action legal? Georgetown Law J. 108, 4, 803.
  27. 10.1257/jel.20181489 · DOI · Paper page
  28. R. Berk . 2016 . A primer on fairness in criminal justice risk assessments . Criminologist 41 , 6, 6 – 9 . R. Berk. 2016. A primer on fairness in criminal justice risk assessments. Criminologist 41, 6, 6–9.
  29. 10.1257/0002828042002561 · DOI · Paper page
  30. D. A. Biddle. 2008. Are the uniform guidelines outdated? Federal guidelines professional standards and validity generalization (VG). Ind. Organ. Psychol. 45 4 17–23. D. A. Biddle. 2008. Are the uniform guidelines outdated? Federal guidelines professional standards and validity generalization (VG). Ind. Organ. Psychol. 45 4 17–23. · DOI
  31. A. Bietti , A. Agarwal , and J. Langford . 2018 . A contextual bandit bake-off . J. Mach. Learn. Res. 22 , 1, 5928 – 5976 . A. Bietti, A. Agarwal, and J. Langford. 2018. A contextual bandit bake-off. J. Mach. Learn. Res. 22, 1, 5928–5976.
  32. S. Bird S. Barocas K. Crawford F. Diaz and H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI. Available at SSRN: https://ssrn.com/abstract=2846909 also appeared at the Workshop on Fairness Accountability and Transparency in Machine Learning. S. Bird S. Barocas K. Crawford F. Diaz and H. Wallach. 2016. Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI . Available at SSRN: https://ssrn.com/abstract=2846909 also appeared at the Workshop on Fairness Accountability and Transparency in Machine Learning.
  33. 10.1109/MSP.2009.24 · DOI
  34. J. Blass . 2019 . Algorithmic advertising discrimination . Northwest. Univ. Law Rev. 114 , 2, 415 – 467 . J. Blass. 2019. Algorithmic advertising discrimination. Northwest. Univ. Law Rev. 114, 2, 415–467.
  35. H. D. Block and J. Marschak. 1960. Random orderings and stochastic theories of responses. In I. Olkin S. G. Ghurye W. Hoeffding W. G. Madow and H. B. Mann (Eds.) Contributions to Probability and Statistics. Stanford University Press 97–132. H. D. Block and J. Marschak. 1960. Random orderings and stochastic theories of responses. In I. Olkin S. G. Ghurye W. Hoeffding W. G. Madow and H. B. Mann (Eds.) Contributions to Probability and Statistics . Stanford University Press 97–132.
  36. 10.1287/mnsc.2015.2186 · DOI · Paper page
  37. 10.2139/ssrn.2913669 · DOI
  38. S. Bornstein . 2018 . Antidiscriminatory algorithms. Ala . Law Rev. 70 , 2 , 519. S. Bornstein. 2018. Antidiscriminatory algorithms. Ala. Law Rev. 70, 2, 519.
  39. 10.1007/BF01918335 · DOI · Paper page
  40. 10.48550/arXiv.0910.1191 · DOI
  41. 10.1093/ijlit/eay017 · DOI · Paper page
  42. 10.1145/2020408.2020495 · DOI · Paper page
  43. J. Buolamwini and T. Gebru . 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification . In Proceedings of the 1st Conference on Fairness, Accountability and Transparency. PMLR, 77–91 . J. Buolamwini and T. Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency. PMLR, 77–91.
  44. 10.1007/s10618-010-0190-x · DOI · Paper page
  45. 10.48550/arXiv.2012.12862 · DOI
  46. 10.1257/aer.20131159 · DOI · Paper page
  47. 10.1145/3394486.3406707 · DOI
  48. M. Cavicchia . 2015 . How to fight implicit bias? With conscious thought, diversity expert tells NABE . American Bar Association: Bar Leader 40 , 1 . M. Cavicchia. 2015. How to fight implicit bias? With conscious thought, diversity expert tells NABE. American Bar Association: Bar Leader 40, 1.
  49. 10.48550/arXiv.1707.02260 · DOI
  50. 10.48550/arXiv.1704.06840 · DOI
  51. 10.1017/iop.2016.6 · DOI · Paper page
  52. 10.1007/s10208-012-9135-7 · DOI · Paper page
  53. 10.1093/qje/qjx044 · DOI · Paper page
  54. 10.1145/3219166.3219175 · DOI
  55. S. N. S. Cheung . 1969. The Theory of Share Tenancy . Arcadia Press . S. N. S. Cheung. 1969. The Theory of Share Tenancy. Arcadia Press.
  56. 10.1609/aaai.v33i01.33017801 · DOI · Paper page
  57. A. Chouldechova , D. Benavides-Prado , O. Fialko , and R. Vaithianathan . 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions . In Proceedings of the 1st Conference on Fairness, Accountability and Transparency , Vol. 18 . PMLR, 134–148. A. Chouldechova, D. Benavides-Prado, O. Fialko, and R. Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency, Vol. 18. PMLR, 134–148.
  58. W. Chu , L. Li , L. Reyzin , and R. E. Schapire . 2011. Contextual bandits with linear payoff functions . In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS) , Vol. 15 . PMLR, 208–214. W. Chu, L. Li, L. Reyzin, and R. E. Schapire. 2011. Contextual bandits with linear payoff functions. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS), Vol. 15. PMLR, 208–214.
  59. D. K. Citron and F. Pasquale . 2014 . The scored society: Due process for automated predictions . Wash. Law Rev. 89 , 1 . D. K. Citron and F. Pasquale. 2014. The scored society: Due process for automated predictions. Wash. Law Rev. 89, 1.
  60. 10.1137/070710111 · DOI · Paper page
  61. S. Coate and G. C. Loury . 1993 . Will affirmative-action policies eliminate negative stereotypes ? Am. Econ. Rev. 83 , 5, 1220 – 1240 . S. Coate and G. C. Loury. 1993. Will affirmative-action policies eliminate negative stereotypes? Am. Econ. Rev. 83, 5, 1220–1240.
  62. I. N. Cofone . 2018 . Algorithmic discrimination is an information problem . Hastings Law J. 70 , 1389 . I. N. Cofone. 2018. Algorithmic discrimination is an information problem. Hastings Law J. 70, 1389.
  63. J. E. Cohen . 2012a. Configuring the Networked Self: Law, Code, and the Play of Everyday Practice . Yale University Press . J. E. Cohen. 2012a. Configuring the Networked Self: Law, Code, and the Play of Everyday Practice. Yale University Press.
  64. J. E. Cohen . 2012 b. What privacy is for . Harv. Law Rev. 126 , 7, 1904 – 1933 . J. E. Cohen. 2012b. What privacy is for. Harv. Law Rev. 126, 7, 1904–1933.
  65. R. M. Cohn . 1979 a. Statistical laws and the use of statistics in law: A rejoinder to Professor Shoben . Indiana Law J. 55 , 3 , 537. R. M. Cohn. 1979a. Statistical laws and the use of statistics in law: A rejoinder to Professor Shoben. Indiana Law J. 55, 3, 537.
  66. R. M. Cohn . 1979 b. On the use of statistics in employment discrimination cases . Indiana Law J. 55 , 3 , 493. R. M. Cohn. 1979b. On the use of statistics in employment discrimination cases. Indiana Law J. 55, 3, 493.
  67. B. W. Collins . 2007 . Tackling unconscious bias in hiring practices: The plight of the Rooney Rule . N. Y. Univ. Law Rev. 82 , 3 , 870. B. W. Collins. 2007. Tackling unconscious bias in hiring practices: The plight of the Rooney Rule. N. Y. Univ. Law Rev. 82, 3, 870.
  68. 10.1145/3097983.3098095 · DOI · Paper page
  69. 10.2139/ssrn.3584916 · DOI
  70. H. Cravens . 1978. The Triumph of Evolution: The Heredity–Environment Controversy , 1900 –1941. Johns Hopkins University Press . H. Cravens. 1978. The Triumph of Evolution: The Heredity–Environment Controversy, 1900–1941. Johns Hopkins University Press.
  71. K. Crawford . 2017 . The trouble with bias . In Proceedings of the Conference on Neural Information Processing Systems, invited speaker. https://blog.revolutionanalytics.com/2017/12/the-trouble-with-bias-by-kate-crawford.html. K. Crawford. 2017. The trouble with bias. In Proceedings of the Conference on Neural Information Processing Systems, invited speaker. https://blog.revolutionanalytics.com/2017/12/the-trouble-with-bias-by-kate-crawford.html.
  72. 10.1177/0962280213497434 · DOI · Paper page
  73. R. Cummings , S. Ioannidis , and K. Ligett . 2015. Truthful linear regression . In Proceedings of the 28th Conference on Learning Theory, COLT 2015 , Vol. 40 . PMLR, 448–483. R. Cummings, S. Ioannidis, and K. Ligett. 2015. Truthful linear regression. In Proceedings of the 28th Conference on Learning Theory, COLT 2015, Vol. 40. PMLR, 448–483.
  74. 10.1145/1014052.1014066 · DOI · Paper page
  75. 10.1111/j.2517-6161.1950.tb00054.x · DOI · Paper page
  76. 10.1007/978-3-319-13129-0_45 · DOI
  77. 10.1002/rsa.10073 · DOI · Paper page
  78. 10.1515/popets-2015-0007 · DOI · Paper page
  79. H. A. David and H. N. Nagaraja. 2005. Basic Distribution Theory. John Wiley & Sons 9–32. ISBN 9780471722168. H. A. David and H. N. Nagaraja. 2005. Basic Distribution Theory . John Wiley & Sons 9–32. ISBN 9780471722168.
  80. 10.48550/arXiv.2101.09648 · arXiv · doi:10.48550/arxiv.2101.09648
  81. 10.1016/j.jcss.2010.03.003 · DOI
  82. A. Dhurandhar P.-Y. Chen R. Luss C.-C. Tu P. Ting K. Shanmugam and P. Das. 2018. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems 592–603. A. Dhurandhar P.-Y. Chen R. Luss C.-C. Tu P. Ting K. Shanmugam and P. Das. 2018. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems 592–603.
  83. 10.1145/3219166.3219193 · DOI
  84. P. H. DuBois . 1970. A History of Psychological Testing. Allyn and Bacon , Boston . P. H. DuBois. 1970. A History of Psychological Testing. Allyn and Bacon, Boston.
  85. C. DuBois and D. W. Schanzenbach. 2017. The Effect of Court-Ordered Hiring Guidelines on Teacher Composition and Student Achievement. Technical Report. National Bureau of Economic Research. C. DuBois and D. W. Schanzenbach. 2017. The Effect of Court-Ordered Hiring Guidelines on Teacher Composition and Student Achievement . Technical Report. National Bureau of Economic Research. · DOI
  86. 10.1146/annurev.ps.30.020179.002401 · DOI · Paper page
  87. 10.1145/2090236.2090255 · DOI · Paper page
  88. H. Edwards and A. J. Storkey . 2016. Censoring representations with an adversary . In Proceedings of the 4th International Conference on Learning Representations (ICLR 2016), San Juan, Puerto Rico, May 2–4, 2016, Conference Track Proceedings. H. Edwards and A. J. Storkey. 2016. Censoring representations with an adversary. In Proceedings of the 4th International Conference on Learning Representations (ICLR 2016), San Juan, Puerto Rico, May 2–4, 2016, Conference Track Proceedings.
  89. 10.1038/scientificamerican1118-68 · DOI
  90. V. Eubanks . 2018 b. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor . St. Martin’s Press . V. Eubanks. 2018b. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin’s Press.
  91. Executive Office of the President. May. 2016 . Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. Technical Report. Executive Office of the President. May. 2016. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. Technical Report.
  92. 10.1137/S0097539791195877 · DOI · Paper page
  93. 10.1145/3442188.3445912 · DOI
  94. A. Flores , C. Lowenkamp , and K. Bechtel . September . 2016 . False Positives, False Negatives , and False Analyses: A Rejoinder to “Machine Bias: There’s Software used Across the Country to Predict Future Criminals. and it’s Biased Against Blacks. ” Technical Report, Crime & Justice Institute . http://www.crj.org/assets/2017/07/9_Machine_bias_rejoinder.pdf. A. Flores, C. Lowenkamp, and K. Bechtel. September. 2016. False Positives, False Negatives, and False Analyses: A Rejoinder to “Machine Bias: There’s Software used Across the Country to Predict Future Criminals. and it’s Biased Against Blacks.” Technical Report, Crime & Justice Institute. http://www.crj.org/assets/2017/07/9_Machine_bias_rejoinder.pdf.
  95. 10.1093/restud/rdw035 · DOI
  96. 10.1093/biomet/85.2.379 · DOI · Paper page
  97. 10.1086/468099 · DOI
  98. 10.1145/2600057.2602897 · DOI
  99. J. Friedman T. Hastie and R. Tibshirani. 2001. The Elements of Statistical Learning. Springer New York. J. Friedman T. Hastie and R. Tibshirani. 2001. The Elements of Statistical Learning . Springer New York.
  100. 10.1086/671180 · DOI
  101. 10.1007/s00355-011-0542-5 · DOI
  102. 10.1111/j.1468-2850.1997.tb00104.x · DOI · Paper page
  103. P. W. Gerhardt . 1916 . Scientific selection of employees . Electric Railway J. 47 , 21, 943 – 945 . P. W. Gerhardt. 1916. Scientific selection of employees. Electric Railway J. 47, 21, 943–945.
  104. 10.1145/3292500.3330691 · DOI · Paper page
  105. T. B. Gillis and J. L. Spiess . 2019 . Big data and discrimination . Univ. Chic. Law Rev. 86 , 2, 459 – 488 . T. B. Gillis and J. L. Spiess. 2019. Big data and discrimination. Univ. Chic. Law Rev. 86, 2, 459–488.
  106. G. Goh , A. Cotter , M. Gupta , and M. P. Friedlander . 2016. Satisfying real-world goals with dataset constraints . In Advances in Neural Information Processing Systems , Vol. 29 . Curran Associates, 2415–2423. G. Goh, A. Cotter, M. Gupta, and M. P. Friedlander. 2016. Satisfying real-world goals with dataset constraints. In Advances in Neural Information Processing Systems, Vol. 29. Curran Associates, 2415–2423.
  107. 10.48550/arXiv.1811.05245 · DOI
  108. 10.23919/JSC.2021.0029 · DOI
  109. 10.1007/s11606-007-0258-5 · DOI · Paper page
  110. 10.2307/20439056 · DOI · Paper page
  111. J. Grimmett . 2017 . Veterinary practitioners—Personal characteristics and professional longevity . VetScript 30 , 11, 54 – 57 . J. Grimmett. 2017. Veterinary practitioners—Personal characteristics and professional longevity. VetScript 30, 11, 54–57.
  112. 10.2307/1912246 · DOI · Paper page
  113. C. Guo , G. Pleiss , Y. Sun , and K. Q. Weinberger . 2017. On calibration of modern neural networks . In Proceedings of the 34th International Conference on Machine Learning , Vol. 70 . PMLR, 1321–1330. C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger. 2017. On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70. PMLR, 1321–1330.
  114. 10.1017/iop.2015.76 · DOI
  115. N. Haghtalab , N. Immorlica , B. Lucier , and J. Z. Wang . 2020. Maximizing welfare with incentive-aware evaluation mechanisms . In Proceedings of the 29th International Joint Conference on Artificial Intelligence. IJCAI, 160–166 N. Haghtalab, N. Immorlica, B. Lucier, and J. Z. Wang. 2020. Maximizing welfare with incentive-aware evaluation mechanisms. In Proceedings of the 29th International Joint Conference on Artificial Intelligence. IJCAI, 160–166
  116. 10.1109/TKDE.2012.72 · DOI · Paper page
  117. 10.15779/Z38QP7R · DOI
  118. 10.1145/2840728.2840730 · DOI · Paper page
  119. M. Hardt , E. Price , and S. Nathan . 2016b. Equality of opportunity in supervised learning . In Advances in Neural Information Processing Systems , Vol. 29 . Curran Associates, 3323–3331. M. Hardt, E. Price, and S. Nathan. 2016b. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems, Vol. 29. Curran Associates, 3323–3331.
  120. Z. Harned and H. Wallach . 2019 . Stretching human laws to apply to machines: The dangers of a “colorblind” computer. Fla . State Univ. Law Rev. 47 , 617 . Z. Harned and H. Wallach. 2019. Stretching human laws to apply to machines: The dangers of a “colorblind” computer. Fla. State Univ. Law Rev. 47, 617.
  121. D. Hellman . 2020 . Measuring algorithmic fairness. Va . Law Rev. 106 , 4, 811 – 866 . D. Hellman. 2020. Measuring algorithmic fairness. Va. Law Rev. 106, 4, 811–866.
  122. 10.48550/arXiv.1806.09809 · DOI
  123. 10.2307/2938287 · DOI · Paper page
  124. 10.1007/s11623-006-0140-3 · DOI
  125. 10.2307/1913238 · DOI · Paper page
  126. 10.1093/jleo/7.special_issue.24 · DOI · Paper page
  127. 10.1093/restud/rdaa070 · DOI
  128. K. Houser . 2019 . Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making . Stanford Technol. Law Rev. 22 , 290 . K. Houser. 2019. Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technol. Law Rev. 22, 290.
  129. 10.1145/3178876.3186044 · DOI
  130. 10.1145/3287560.3287597 · DOI
  131. A. E. Hurley-Hanson and C. M. Giannantonio ( Eds .). 2016 . Journal of Business Management . Autism in the Workplace , Vol. 22 . Chapman University Argyros School of Business and Economics. https://www.chapman.edu/business/_files/journals-and-essays/jbm-editions/jbm-vol-22-no-1-autism-in-the-workplace.pdf. A. E. Hurley-Hanson and C. M. Giannantonio (Eds.). 2016. Journal of Business Management. Autism in the Workplace, Vol. 22. Chapman University Argyros School of Business and Economics. https://www.chapman.edu/business/_files/journals-and-essays/jbm-editions/jbm-vol-22-no-1-autism-in-the-workplace.pdf.
  132. 10.4230/LIPIcs.FORC.2020.2 · DOI
  133. 10.1016/j.spl.2017.11.017 · DOI
  134. 10.1016/0304-405X(76)90026-X · DOI · Paper page
  135. 10.1023/A:1010058117460 · DOI
  136. 10.2307/20439057 · DOI · Paper page
  137. D. Kahneman and A. Tversky . 1977 . Intuitive Prediction: Biases and Corrective Procedures. Technical Report. Decisions and Designs , Inc., Mclean, VA. D. Kahneman and A. Tversky. 1977. Intuitive Prediction: Biases and Corrective Procedures. Technical Report. Decisions and Designs, Inc., Mclean, VA.
  138. 10.1146/annurev-economics-080218-025739 · DOI · Paper page
  139. 10.1257/aer.101.6.2590 · DOI · Paper page
  140. 10.1007/978-3-642-33486-3_3 · DOI · Paper page
  141. 10.48550/arXiv.1801.03423 · DOI
  142. 10.48550/arXiv.1905.11190 · DOI
  143. M. Kearns , A. Roth , and Z. S. Wu . 2017. Meritocratic fairness for cross-population selection . In Proceedings of the 34th International Conference on Machine Learning , Vol. 70 . PMLR, 1828 –1836. M. Kearns, A. Roth, and Z. S. Wu. 2017. Meritocratic fairness for cross-population selection. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70. PMLR, 1828–1836.
  144. W. F. Kemble . 1916 . Testing the fitness of your employees . Ind. Manage. 52 , 149 – 164 W. F. Kemble. 1916. Testing the fitness of your employees. Ind. Manage. 52, 149–164
  145. 10.1093/biomet/30.1-2.81 · DOI · Paper page
  146. 10.5465/255378 · doi:10.5465/255378 · Paper page
  147. L. M. Khan and D. E. Pozen . 2019 . A skeptical view of information fiduciaries . Harv. Law Rev. 133 , 2, 497 – 541 . L. M. Khan and D. E. Pozen. 2019. A skeptical view of information fiduciaries. Harv. Law Rev. 133, 2, 497–541.
  148. M. P. Kim , A. Korolova , G. N. Rothblum , and G. Yona . 2020. Preference-informed fairness . In 11th Innovations in Theoretical Computer Science Conference , Vol. 151 . Schloss Dagstuhl–Leibniz-Zentrum für Informatik, 16:1–16:23. M. P. Kim, A. Korolova, G. N. Rothblum, and G. Yona. 2020. Preference-informed fairness. In 11th Innovations in Theoretical Computer Science Conference, Vol. 151. Schloss Dagstuhl–Leibniz-Zentrum für Informatik, 16:1–16:23.
  149. P. T. Kim . 2016 . Data-driven discrimination at work . William Mary Law Rev. 58 , 3, 857 – 936 . P. T. Kim. 2016. Data-driven discrimination at work. William Mary Law Rev. 58, 3, 857–936.
  150. P. T. Kim . 2017 . Auditing algorithms for discrimination . Univ. Pa. Law Rev. Online 166 , 1 , 189. P. T. Kim. 2017. Auditing algorithms for discrimination. Univ. Pa. Law Rev. Online 166, 1, 189.
  151. P. T. Kim . 2018 . Big data and artificial intelligence: New challenges for workplace equality . Univ. Louisv. Law Rev. 57 , 2, 313 – 328 . P. T. Kim. 2018. Big data and artificial intelligence: New challenges for workplace equality. Univ. Louisv. Law Rev. 57, 2, 313–328.
  152. P. T. Kim . 2020 . Manipulating opportunity. Va . Law Rev. 106 , 4, 867 – 935 . P. T. Kim. 2020. Manipulating opportunity. Va. Law Rev. 106, 4, 867–935.
  153. 10.48550/arXiv.1801.03533 · arXiv · doi:10.48550/arxiv.1801.03533
  154. 10.1145/3417742 · DOI
  155. 10.1007/s10994-010-5178-7 · DOI · Paper page
  156. J. Kleinberg , S. Mullainathan , and M. Raghavan . 2017. Inherent trade-offs in the fair determination of risk scores . In Innovations in Theoretical Computer Science , Vol. 67 . Schloss Dagstuhl–Leibniz-Zentrum fur Informatik, 43:1–43:23. J. Kleinberg, S. Mullainathan, and M. Raghavan. 2017. Inherent trade-offs in the fair determination of risk scores. In Innovations in Theoretical Computer Science, Vol. 67. Schloss Dagstuhl–Leibniz-Zentrum fur Informatik, 43:1–43:23.
  157. 10.1093/qje/qjx032 · DOI · Paper page
  158. D. M. Koretz. 2008. Measuring Up. Harvard University Press. D. M. Koretz. 2008. Measuring Up . Harvard University Press. · DOI · Paper page
  159. D. Koretz , R. Linn , S. Dunbar , and L. Shepard . 1991. The effects of high-stakes testing on achievement: Preliminary findings about generalization across tests . In Annual Meetings of the American Educational Research Association and the National Council on Measurement in Education. D. Koretz, R. Linn, S. Dunbar, and L. Shepard. 1991. The effects of high-stakes testing on achievement: Preliminary findings about generalization across tests. In Annual Meetings of the American Educational Research Association and the National Council on Measurement in Education.
  160. 10.1080/17470211003770912 · DOI
  161. 10.1086/676597 · DOI
  162. J. A. Kroll , J. Huey , S. Barocas , E. W. Felten , J. R. Reidenberg , D. G. Robinson , and H. Yu . 2016 . Accountable algorithms . Univ. Pa. Law Rev. 165 , 3 , 633. J. A. Kroll, J. Huey, S. Barocas, E. W. Felten, J. R. Reidenberg, D. G. Robinson, and H. Yu. 2016. Accountable algorithms. Univ. Pa. Law Rev. 165, 3, 633.
  163. M. J. Kusner , J. R. Loftus , C. Russell , and R. Silva . 2017. Counterfactual fairness . In Advances in Neural Information Processing Systems , Vol. 30 . Curran Associates. M. J. Kusner, J. R. Loftus, C. Russell, and R. Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates.
  164. J.-J. Laffont and D. Martimort. 2009. The Theory of Incentives: The Principal–Agent Model. Princeton University Press. J.-J. Laffont and D. Martimort. 2009. The Theory of Incentives: The Principal–Agent Model . Princeton University Press. · doi:10.2307/j.ctv7h0rwr
  165. J. Langford and T. Zhang. 2007. The epoch-greedy algorithm for contextual multi-armed bandits. In Advances in Neural Information Processing Systems (NeurIPS). Curran Associates 817–824. J. Langford and T. Zhang. 2007. The epoch-greedy algorithm for contextual multi-armed bandits. In Advances in Neural Information Processing Systems (NeurIPS) . Curran Associates 817–824.
  166. 10.1145/1772690.1772758 · DOI · Paper page
  167. Z. C. Lipton , J. McAuley , and A. Chouldechova . 2018. Does mitigating ML’s impact disparity require treatment disparity ? In Advances in Neural Information Processing Systems , Vol. 31 . Curran Associates, 8125–8135. Z. C. Lipton, J. McAuley, and A. Chouldechova. 2018. Does mitigating ML’s impact disparity require treatment disparity? In Advances in Neural Information Processing Systems, Vol. 31. Curran Associates, 8125–8135.
  168. 10.48550/arXiv.1707.01875 · DOI
  169. 10.48550/arXiv.1803.04383 · DOI
  170. 10.4169/math.mag.84.5.365 · DOI
  171. T. Lu and C. Boutilier . 2011. Learning Mallows models with pairwise preferences . In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML ’11) . Omnipress, 145–152. T. Lu and C. Boutilier. 2011. Learning Mallows models with pairwise preferences. In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML ’11). Omnipress, 145–152.
  172. G. F. Madaus and M. Clarke . 2001 . The Adverse Impact of High Stakes Testing on Minority Students: Evidence from 100 Years of Test Data. Technical Report. ERIC. G. F. Madaus and M. Clarke. 2001. The Adverse Impact of High Stakes Testing on Minority Students: Evidence from 100 Years of Test Data. Technical Report. ERIC.
  173. D. Madras , E. Creager , T. Pitassi , and R. Zemel . 2018. Learning adversarially fair and transferable representations . In Proceedings of the 35th International Conference on Machine Learning , Vol. 80 , Stockholmsmässan, Stockholm, Sweden, July 10–15. PMLR, 3384–3393. D. Madras, E. Creager, T. Pitassi, and R. Zemel. 2018. Learning adversarially fair and transferable representations. In Proceedings of the 35th International Conference on Machine Learning, Vol. 80, Stockholmsmässan, Stockholm, Sweden, July 10–15. PMLR, 3384–3393.
  174. 10.1145/3308558.3313717 · DOI
  175. 10.1093/idpl/ipx019 · DOI · Paper page
  176. 10.1080/03461238.1966.10404562 · DOI
  177. 10.1093/biomet/44.1-2.114 · DOI · Paper page
  178. 10.1007/BF00133443 · DOI · Paper page
  179. 10.1145/2764468.2764508 · DOI
  180. 10.4230/LIPIcs.ITCS.2018.48 · DOI
  181. 10.2307/2555714 · DOI · Paper page
  182. 10.1111/j.1754-9434.2011.01382.x · DOI
  183. 10.1145/3457607 · DOI · Paper page
  184. 10.1007/978-3-319-64955-9_4 · DOI · Paper page
  185. J. Miller , S. Milli , and M. Hardt . 2020. Strategic classification is causal modeling in disguise . In Proceedings of the 37th International Conference on Machine Learning , Vol. 119 . PMLR, 6917–6926. J. Miller, S. Milli, and M. Hardt. 2020. Strategic classification is causal modeling in disguise. In Proceedings of the 37th International Conference on Machine Learning, Vol. 119. PMLR, 6917–6926.
  186. 10.1145/3287560.3287576 · DOI
  187. 10.1093/biomet/18.3-4.395 · DOI
  188. 10.3386/w26739 · DOI
  189. H. Munsterberg . 1998. Psychology and Industrial Efficiency , Vol. 49 . A&C Black . H. Munsterberg. 1998. Psychology and Industrial Efficiency, Vol. 49. A&C Black.
  190. 10.1037/14404-000 · DOI · Paper page
  191. 10.1137/S0097539792240406 · DOI · Paper page
  192. 10.17226/1338 · DOI
  193. 10.17226/18427 · DOI
  194. 10.2307/2946676 · DOI · Paper page
  195. H. Nissenbaum . 2009. Privacy in Context: Technology, Policy, and the Integrity of Social Life . Stanford University Press . H. Nissenbaum. 2009. Privacy in Context: Technology, Policy, and the Integrity of Social Life. Stanford University Press.
  196. S. U. Noble . 2018. Algorithms of Oppression: How Search Engines Reinforce Racism . NYU Press . S. U. Noble. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press.
  197. 10.1037/h0040291 · DOI · Paper page
  198. 10.7916/cblr.v2016i2.1739 · DOI
  199. 10.1287/mnsc.2016.2697 · DOI
  200. M. V. Pauly . 1968 . The economics of moral hazard : Comment. Am. Econ. Rev. 58 , 3, 531 – 537 . M. V. Pauly. 1968. The economics of moral hazard: Comment. Am. Econ. Rev. 58, 3, 531–537.

200 of 263 shown

Cited by

See all 310

Metadata

Venue
The Societal Impacts of Algorithmic Decision-Making
Publisher
ACM
Published
2023-09-07
DOI
10.1145/3603195.3603197
OpenAlex
W2522104760
Cited by
310
References
56
FWCI
66.80
Type
book chapter
Language
en
Open access
closed
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Inherent Tradeoffs in the Fair Determination of Risk Scores. https://app.cochat.ai/papers/10.1145/3603195.3603197
The paper
Inherent Tradeoffs in the Fair Determination of Risk Scores. (2023). The Societal Impacts of Algorithmic Decision-Making. https://doi.org/10.1145/3603195.3603197

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.