Case study: predictive fairness to reduce misdemeanor recidivism through social service interventions
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
The criminal justice system is currently ill-equipped to improve outcomes of individuals who cycle in and out of the system with a series of misdemeanor offenses. Often due to constraints of caseload and poor record linkage, prior interactions with an individual may not be considered when an individual comes back into the system, let alone in a proactive manner through the application of diversion programs. The Los Angeles City Attorney's Office recently created a new Recidivism Reduction and Drug Diversion unit (R2D2) tasked with reducing recidivism in this population. Here we describe a collaboration with this new unit as a case study for the incorporation of predictive equity into machine learning based decision making in a resource-constrained setting. The program seeks to improve outcomes by developing individually-tailored social service interventions (i.e., diversions, conditional plea agreements, stayed sentencing, or other favorable case disposition based on appropriate social service linkage rather than traditional sentencing methods) for individuals likely to experience subsequent interactions with the criminal justice system, a time and resource-intensive undertaking that necessitates an ability to focus resources on individuals most likely to be involved in a future case. Seeking to achieve both efficiency (through predictive accuracy) and equity (improving outcomes in traditionally under-served communities and working to mitigate existing disparities in criminal justice outcomes), we discuss the equity outcomes we seek to achieve, describe the corresponding choice of a metric for measuring predictive fairness in this context, and explore a set of options for balancing equity and efficiency when building and selecting machine learning models in an operational public policy setting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 5×
“Where an existing classifier shows disparate results, Dwork [20] described methods for eliminating biases by learning separate group-specific models on top of the existing classifier, and Hardt [30] likewise describes model-agnostic post-processing steps to mitigate disparities.”
InfluentialFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 5×
“Previous work has enumerated metrics for evaluating bias [27, 58], explored inherent conflicts in satisfying them [12, 30], and described case studies and applications to a variety of problems [6, 14, 30, 46].”
InfluentialEnsuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341 · cited 1×
“lored inherent conflicts in satisfying them [12, 30], and Predictive Equity Case Study FAT* ’20, January 27–30, 2020, Barcelona, Spain described case studies and applications to a variety of problems [6, 14, 30, 46]. The main contributions of this work include our framework for equity analysis, methods for balancing e…”
A Reductions Approach to Fair Classification
Agarwal, A., Beygelzimer, A., Dudík, M., Langford, J., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1803.02453 · Cited by 1,288
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Fairness definitions explained
Verma, S., & Rubin, J. (2018) · Proceedings of the International Workshop on Software Fairness · doi:10.1145/3194770.3194776 · Cited by 1,124 · cited 2×
“Previous work has enumerated metrics for evaluating bias [27, 58], explored inherent conflicts in satisfying them [12, 30], and described case studies and applications to a variety of problems [6, 14, 30, 46].”
Fairness Constraints: Mechanisms for Fair Classification
Zafar, M. B., Valera, I., Rodriguez, M. G., & Gummadi, K. P. (2015) · arXiv · doi:10.48550/arxiv.1507.05259 · Cited by 645
Zafar, M. B., Valera, I., Gomez Rodriguez, M., & Gummadi, K. P. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052660 · Cited by 632
The Structure of Racism in Color-Blind, “Post-Racial” America
Bonilla-Silva, E. (2015) · American Behavioral Scientist · doi:10.1177/0002764215586826 · Cited by 549 · cited 1×
“However, concepts of fairness through unawareness have been consistently demonstrated to be misguided [8, 10, 19, 25, 38, 54], and any process that seeks to balance the dual goals of equity and efficiency will face an inherent trade-off between these objectives, even where it is obscured by the process involved.”
Aequitas: A Bias and Fairness Audit Toolkit
Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K. T., & Ghani, R. (2018) · arXiv · doi:10.48550/arxiv.1811.05577 · Cited by 496
Self-citationRISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*
SKEEM, J. L., & LOWENKAMP, C. T. (2016) · Criminology · doi:10.1111/1745-9125.12123 · Cited by 317 · cited 1×
“While some (such as Picard and colleagues [45] as well as Skeem and Lownkamp [49]) see the promise of algorithms carefully designed with equity in mind to improve on a status quo rife with subjectivity and biases, others raise questions about the practical ability of these tools to overcome existing disparities in the…”
Classification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees
Celis, L. E., Huang, L., Keswani, V., & Vishnoi, N. K. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287586 · Cited by 231
Harcourt, B. E. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.237 · Cited by 210
Why Unbiased Computational Processes Can Lead to Discriminative Decision Procedures
Calders, T., & Žliobaitė, I. (2013) · Studies in Applied Philosophy, Epistemology and Rational Ethics · doi:10.1007/978-3-642-30487-3_3 · Cited by 128
Putting Fairness Principles into Practice: Challenges, Metrics, and Improvements
Beutel, A., Chen, J., Doshi, T., Qian, H., Woodruff, A., Luu, C., Kreitmann, P., Bischof, J., & Chi, E. H. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314234 · Cited by 111
Deploying Machine Learning Models for Public Policy: A Framework
Ackermann, K., Walsh, J., De Unánue, A., Naveed, H., Navarrete Rivera, A., Lee, S.-J., Bennett, J., Defoe, M., Cody, C., Haynes, L., et al. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219911 · Cited by 22 · cited 1×
“Feature construction, model training, and performance evaluation was performed with the open-source machine learning toolkit, triage [1].”
Self-citation
Research works printed but not linked: 33
- Jason R. Bent. 2019. Is Algorithmic Affirmative Action Legal? Georgetown Law Journal Forthcoming (4 2019), 1--59. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3372690
- Beverly Press Staff Reporters. 2017. Los Angeles City Attorney's Office awarded for outstanding performance by a public sector law office. https://beverlypress.com/2017/09/los-angeles-city-attorneys-office-awarded-for-outstanding-performance-by-a-public-sector-law-office/
- Irene Y Chen Fredrik D Johansson and David Sontag. 2018. Why Is My Classifier Discriminatory?. In Advances in Neural Information Processing Systems 31. NIPS Montreal Canada 12. http://papers.nips.cc/paper/7613-why-is-my-classifier-discriminatory.pdf
- Alexandra Chouldechova and Max G'Sell. 2017. Fairer and more accurate, but for whom? (6 2017), 8 pages. http://arxiv.org/abs/1707.00046 · arXiv
- Alexandra Chouldechova, Emily Putnam-Hornstein, Suzanne Dworak-Peck, Diana Benavides-Prado, Oleksandr Fialko, Rhema Vaithianathan, Sorelle A Friedler, and Christo Wilson. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. Proceedings of Machine Learning Research 81 (2018), 134--148. http://proceedings.mlr.press/v81/chouldechova18a/chouldechova18a.pdf
- 10.1002/bsl.542 · DOI · Paper page
- 10.1177/1043986204266892 · DOI
- Nora V. Demleitner. 2002. Collateral Damage: No Re-Entry for Drug Offenders. Villanova Law Review 47 (2002), 1027--1054. https://heinonline.org/HOL/Page?handle=hein.journals/vllalr47&id=1041&div=42&collection=journals
- Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, and Max Leiserson. 2018. Decoupled Classifiers for Group-Fair and Efficient Machine Learning. Proceedings of Machine Learning Research 81 81 (1 2018), 119--133. http://proceedings.mlr.press/v81/dwork18a.html
- Harrison Edwards and Amos Storkey. 2015. Censoring Representations with an Adversary. (11 2015), 14 pages. http://arxiv.org/abs/1511.05897 · arXiv
- Manuela Ekowo and Iris Palmer. 2016. The Promise and Peril of Predictive Analytics in Higher Education: A Landscape Analysis Acknowledgments About the Education Policy Program. Technical Report. New America, Washington, DC. https://www.newamerica.org/education-policy/policy-papers/promise-and-peril-predictive-analytics-higher-education/
- 10.1093/jleo/ewm053 · DOI
- Pratik Gajane and Mykola Pechenizkiy. 2018. On Formalizing Fairness in Prediction with Machine Learning. (2018) 6 pages. https://arxiv.org/pdf/1710.03184.pdf · arXiv
- 10.1080/10345329.2010.12035888 · DOI
- 10.1007/s11414-007-9057-3 · doi:10.1007/s11414-007-9057-3
- Aziz Z. Huq. 2019. Racial Equity in Algorithmic Criminal Justice. Duke Law Journal 68, 6 (2019), 1043--1134. https://heinonline.org/HOL/Page?handle=hein.journals/duklr68&id=1067&div=33&collection=journals
- Rob J Hyndman and George Athanasopoulos. 2018. Forecasting: Principles and Practice (2 ed.). OTexts, Melbourne, Australia. https://otexts.com/fpp2/
- Pauline T. Kim. 2016. Data-Driven Discrimination at Work. William & Mary Law Review 58 (2016), 857--936. https://heinonline.org/HOL/Page?handle=hein.journals/wmlr58&id=887&div=24&collection=journals
- Pauline T. Kim. 2017. Auditing Algorithms for Discrimination. University of Pennsylvania Law Review Online 166 (2017), 189--204. https://heinonline.org/HOL/Page?handle=hein.journals/pennumbra166&id=189&div=15&collection=journals
- L. L. Kondo. 2000. Therapeutic jurisprudence. Issues, analysis and applications: Advocacy of the establishment of mental health specialty courts in the provision of therapeutic justice for mentally ill offenders. Seattle University Law Review 24 (2000), 373--464.
- Joshua A. Kroll, Solon Barocas, Edward W. Felten, Joel R. Reidenberg, David G. Robinson, and Harlan Yu. 2016. Accountable Algorithms. University of Pennsylvania Law Review 165 (2016), 633--706. https://heinonline.org/HOL/Page?handle=hein.journals/pnlr165&id=648&div=20&collection=journals
- 10.1093/pch/14.1.15 · DOI
- H.R. Lamb L.E. Weinberger and C. Reston-Parham. 1996. Court intervention to address the mental health needs of mentally ill offenders. Psychiatric Services 47 3 (3 1996) 275--281. 10.1176/ps.47.3.275 · doi:10.1176/ps.47.3.275
- Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems 31. NIPS Montreal Canada 11. http://papers.nips.cc/paper/8035-does-mitigating-mls-impact-disparity-require-treatment-disparity
- Mark MacCarthy. 2017. Standards of Fairness for Disparate Impact Assessment of Big Data Algorithms. Cumberland Law Review 48 (2017), 67--148. https://heinonline.org/HOL/Page?handle=hein.journals/cumlr48&id=139&div=8&collection=journals
- Sandra G Mayson. 2019. Bias In, Bias Out. Yale Law Journal 128 (2019), 2018--2035. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3257004
- 10.1002/bsl.640 · DOI · Paper page
- T. Howard Stone. 1997. Therapeutic implications of incarceration for persons with severe mental disorders: Searching for rational health policy. American Journal of Criminal Law 24 (1997), 283--358.
- 10.1145/3340470.3340478 · DOI
- Andrew E. Taslitz. 2007. Racial Blindsight: The Absurdity of Color-Blind Criminal Justice. Ohio State Journal of Criminal Law 5 (2007), 1--18. https://heinonline.org/HOL/Page?handle=hein.journals/osjcl5&id=5&div=5&collection=journals
- 10.1177/0011128702239234 · DOI
- 10.1176/ps.49.10.1330 · DOI · Paper page
- Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning Fair Representations. Proceedings of Machine Learning Research 28, 3 (2 2013), 325--333. http://proceedings.mlr.press/v28/zemel13.html?version=meter+at+null&module=meter-Links&pgtype=article&contentId=&mediaId=&referrer=&priority=true&action=click&contentCollection=meter-links-click
Cited by
Evaluation and Mitigation of Racial Bias in Clinical Machine Learning Models: Scoping Review
Huang, J., Galal, G., Etemadi, M., & Vaidyanathan, M. (2022) · JMIR Medical Informatics · doi:10.2196/36388 · Cited by 186
“Obermeyer et al [36] present an example of using model calibration in conjunction with varied outcome labels to successfully de-bias an algorithm used to manage population health, and case studies have examined trade-offs of bias evaluation metrics in other settings, such as criminal justice [44], which may also serve…”
Model Multiplicity: Opportunities, Concerns, and Solutions
Black, E., Raghavan, M., & Barocas, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533149 · Cited by 85
Explainable machine learning for public policy: Use cases, gaps, and research directions
Amarasinghe, K., Rodolfa, K. T., Lamba, H., & Ghani, R. (2023) · Data & Policy · doi:10.1017/dap.2023.2 · Cited by 73
“The proliferation of Machine Learning (ML) applications has extended to decision-support systems in public policy areas such as criminal justice, education, healthcare, and social services [7, 11, 33, 38, 47].”
BackgroundMethodSelf-citationRodolfa, K. T., Lamba, H., & Ghani, R. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00396-x · Cited by 10
Self-citation
Metadata
- Authors
- Rodolfa, K. T., Salomon, E., Haynes, L., Mendieta, I. H., Larson, J., & Ghani, R.
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 142-153
- OpenAlex
- W3000952406
- Cited by
- 36
- References
- 17
- FWCI
- 4.85
- Type
- conference paper
- Language
- en
- Open access
- green
- Funders
- Laura and John Arnold Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.