CoChat

Case study: predictive fairness to reduce misdemeanor recidivism through social service interventions

Open access
Rodolfa, Kit T., Salomon, Erika, Haynes, Lauren, Mendieta, Iván Higuera, Larson, Jamie, Ghani, Rayid · 2020 · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Cited by 36

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

The criminal justice system is currently ill-equipped to improve outcomes of individuals who cycle in and out of the system with a series of misdemeanor offenses. Often due to constraints of caseload and poor record linkage, prior interactions with an individual may not be considered when an individual comes back into the system, let alone in a proactive manner through the application of diversion programs. The Los Angeles City Attorney's Office recently created a new Recidivism Reduction and Drug Diversion unit (R2D2) tasked with reducing recidivism in this population. Here we describe a collaboration with this new unit as a case study for the incorporation of predictive equity into machine learning based decision making in a resource-constrained setting. The program seeks to improve outcomes by developing individually-tailored social service interventions (i.e., diversions, conditional plea agreements, stayed sentencing, or other favorable case disposition based on appropriate social service linkage rather than traditional sentencing methods) for individuals likely to experience subsequent interactions with the criminal justice system, a time and resource-intensive undertaking that necessitates an ability to focus resources on individuals most likely to be involved in a future case. Seeking to achieve both efficiency (through predictive accuracy) and equity (improving outcomes in traditionally under-served communities and working to mitigate existing disparities in criminal justice outcomes), we discuss the equity outcomes we seek to achieve, describe the corresponding choice of a metric for measuring predictive fairness in this context, and explore a set of options for balancing equity and efficiency when building and selecting machine learning models in an operational public policy setting.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3351095.3372863

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 17 references

Research works printed but not linked: 33

  1. Jason R. Bent. 2019. Is Algorithmic Affirmative Action Legal? Georgetown Law Journal Forthcoming (4 2019), 1--59. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3372690
  2. Beverly Press Staff Reporters. 2017. Los Angeles City Attorney's Office awarded for outstanding performance by a public sector law office. https://beverlypress.com/2017/09/los-angeles-city-attorneys-office-awarded-for-outstanding-performance-by-a-public-sector-law-office/
  3. Irene Y Chen Fredrik D Johansson and David Sontag. 2018. Why Is My Classifier Discriminatory?. In Advances in Neural Information Processing Systems 31. NIPS Montreal Canada 12. http://papers.nips.cc/paper/7613-why-is-my-classifier-discriminatory.pdf
  4. Alexandra Chouldechova and Max G'Sell. 2017. Fairer and more accurate, but for whom? (6 2017), 8 pages. http://arxiv.org/abs/1707.00046 · arXiv
  5. Alexandra Chouldechova, Emily Putnam-Hornstein, Suzanne Dworak-Peck, Diana Benavides-Prado, Oleksandr Fialko, Rhema Vaithianathan, Sorelle A Friedler, and Christo Wilson. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. Proceedings of Machine Learning Research 81 (2018), 134--148. http://proceedings.mlr.press/v81/chouldechova18a/chouldechova18a.pdf
  6. 10.1002/bsl.542 · DOI · Paper page
  7. 10.1177/1043986204266892 · DOI
  8. Nora V. Demleitner. 2002. Collateral Damage: No Re-Entry for Drug Offenders. Villanova Law Review 47 (2002), 1027--1054. https://heinonline.org/HOL/Page?handle=hein.journals/vllalr47&id=1041&div=42&collection=journals
  9. Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, and Max Leiserson. 2018. Decoupled Classifiers for Group-Fair and Efficient Machine Learning. Proceedings of Machine Learning Research 81 81 (1 2018), 119--133. http://proceedings.mlr.press/v81/dwork18a.html
  10. Harrison Edwards and Amos Storkey. 2015. Censoring Representations with an Adversary. (11 2015), 14 pages. http://arxiv.org/abs/1511.05897 · arXiv
  11. Manuela Ekowo and Iris Palmer. 2016. The Promise and Peril of Predictive Analytics in Higher Education: A Landscape Analysis Acknowledgments About the Education Policy Program. Technical Report. New America, Washington, DC. https://www.newamerica.org/education-policy/policy-papers/promise-and-peril-predictive-analytics-higher-education/
  12. 10.1093/jleo/ewm053 · DOI
  13. Pratik Gajane and Mykola Pechenizkiy. 2018. On Formalizing Fairness in Prediction with Machine Learning. (2018) 6 pages. https://arxiv.org/pdf/1710.03184.pdf · arXiv
  14. 10.1080/10345329.2010.12035888 · DOI
  15. 10.1007/s11414-007-9057-3 · doi:10.1007/s11414-007-9057-3
  16. Aziz Z. Huq. 2019. Racial Equity in Algorithmic Criminal Justice. Duke Law Journal 68, 6 (2019), 1043--1134. https://heinonline.org/HOL/Page?handle=hein.journals/duklr68&id=1067&div=33&collection=journals
  17. Rob J Hyndman and George Athanasopoulos. 2018. Forecasting: Principles and Practice (2 ed.). OTexts, Melbourne, Australia. https://otexts.com/fpp2/
  18. Pauline T. Kim. 2016. Data-Driven Discrimination at Work. William & Mary Law Review 58 (2016), 857--936. https://heinonline.org/HOL/Page?handle=hein.journals/wmlr58&id=887&div=24&collection=journals
  19. Pauline T. Kim. 2017. Auditing Algorithms for Discrimination. University of Pennsylvania Law Review Online 166 (2017), 189--204. https://heinonline.org/HOL/Page?handle=hein.journals/pennumbra166&id=189&div=15&collection=journals
  20. L. L. Kondo. 2000. Therapeutic jurisprudence. Issues, analysis and applications: Advocacy of the establishment of mental health specialty courts in the provision of therapeutic justice for mentally ill offenders. Seattle University Law Review 24 (2000), 373--464.
  21. Joshua A. Kroll, Solon Barocas, Edward W. Felten, Joel R. Reidenberg, David G. Robinson, and Harlan Yu. 2016. Accountable Algorithms. University of Pennsylvania Law Review 165 (2016), 633--706. https://heinonline.org/HOL/Page?handle=hein.journals/pnlr165&id=648&div=20&collection=journals
  22. 10.1093/pch/14.1.15 · DOI
  23. H.R. Lamb L.E. Weinberger and C. Reston-Parham. 1996. Court intervention to address the mental health needs of mentally ill offenders. Psychiatric Services 47 3 (3 1996) 275--281. 10.1176/ps.47.3.275 · doi:10.1176/ps.47.3.275
  24. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems 31. NIPS Montreal Canada 11. http://papers.nips.cc/paper/8035-does-mitigating-mls-impact-disparity-require-treatment-disparity
  25. Mark MacCarthy. 2017. Standards of Fairness for Disparate Impact Assessment of Big Data Algorithms. Cumberland Law Review 48 (2017), 67--148. https://heinonline.org/HOL/Page?handle=hein.journals/cumlr48&id=139&div=8&collection=journals
  26. Sandra G Mayson. 2019. Bias In, Bias Out. Yale Law Journal 128 (2019), 2018--2035. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3257004
  27. 10.1002/bsl.640 · DOI · Paper page
  28. T. Howard Stone. 1997. Therapeutic implications of incarceration for persons with severe mental disorders: Searching for rational health policy. American Journal of Criminal Law 24 (1997), 283--358.
  29. 10.1145/3340470.3340478 · DOI
  30. Andrew E. Taslitz. 2007. Racial Blindsight: The Absurdity of Color-Blind Criminal Justice. Ohio State Journal of Criminal Law 5 (2007), 1--18. https://heinonline.org/HOL/Page?handle=hein.journals/osjcl5&id=5&div=5&collection=journals
  31. 10.1177/0011128702239234 · DOI
  32. 10.1176/ps.49.10.1330 · DOI · Paper page
  33. Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning Fair Representations. Proceedings of Machine Learning Research 28, 3 (2 2013), 325--333. http://proceedings.mlr.press/v28/zemel13.html?version=meter+at+null&module=meter-Links&pgtype=article&contentId=&mediaId=&referrer=&priority=true&action=click&contentCollection=meter-links-click

Cited by

Metadata

Authors
Rodolfa, K. T., Salomon, E., Haynes, L., Mendieta, I. H., Larson, J., & Ghani, R.
Venue
Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2020-01-27
Pages
142-153
OpenAlex
W3000952406
Cited by
36
References
17
FWCI
4.85
Type
conference paper
Language
en
Open access
green
Funders
Laura and John Arnold Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.