Impact of risk assessment on judges’ fairness in sentencing relatively poor defendants
Open accessAbstract
OBJECTIVE: Use of risk assessment instruments in the criminal justice system is controversial. Advocates emphasize that risk assessments are more transparent, consistent, and accurate in predicting re-offending than judicial intuition. Skeptics worry that risk assessments will increase socioeconomic disparities in incarceration. Ultimately, judges make decisions-not risk assessments. This study tests whether providing risk assessment information interacts with a defendant's socioeconomic class to influence judges' sentencing decisions. HYPOTHESES: Tentatively, socioeconomic status was expected to have a main effect; without an interaction with risk assessment information. METHOD: Judges (N = 340) with sentencing experience were randomly assigned to review 1 of 4 case vignettes and sentence the defendant to probation, jail, or prison. Information in the vignettes was held constant, except the defendant's socioeconomic status and whether risk assessment information was provided. RESULTS: Risk assessment information reduced the likelihood of incarceration for relatively affluent defendants, but the same information increased the likelihood of incarceration for relatively poor defendants. This finding held after controlling for the sex, race, political orientation, and jurisdiction of the judge. CONCLUSIONS: Cuing judges to focus on risk may re-frame how they process socioeconomic status-a variable with opposite effects on perceptions of blameworthiness for past crime versus perceptions of risk for future crime. Providing risk assessment information may have transformed low socioeconomic status from a circumstance that reduced the likelihood of incarceration (by mitigating perceived blameworthiness) to a factor that increased the likelihood of incarceration (by increasing perceived risk). Under some circumstances, risk assessment information may increase sentencing disparities. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Even when people do not rely entirely on automation, an algorithm can still significantly alter how people make decisions.
“even when people do not rely entirely on automation, an algorithm can still significantly alter how people make decisions”
From The flaws of policies requiring human oversight of government algorithms (2022) · cites this paper as Skeem et al., 2019
Experimental studies suggest that risk assessments increase the weight that judges, law students, and laypeople place on risk relative to other considerations when making simulated pretrial and sentencing decisions.
“Experimental studies suggest that risk assessments increase the weight that judges, law students, and laypeople place on risk relative to other considerations when making simulated pretrial and sentencing decisions”
From The flaws of policies requiring human oversight of government algorithms (2022) · cites this paper as Skeem et al., 2019
Cited by
Sorted by citations
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 347 · see citing works
The flaws of policies requiring human oversight of government algorithms
Green, B. (2022) · Computer Law & Security Review · doi:10.1016/j.clsr.2022.105681 · Cited by 263 · see citing works
Algorithms and Decision-Making in the Public Sector
Levy, K. E. C., Chasalow, K. E., & Riley, S. (2021) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-041221-023808 · Cited by 134 · see citing works
“In the criminal justice context, for instance, some research demonstrates significant heterogeneity in compliance with risk assessment recommendations along dimensions of age (Stevenson & Doleac 2019), race (Albright 2019), and income (Skeem et al. 2020).”
BackgroundAlgorithmic fairness in business analytics: Directions for research and practice
De‐Arteaga, M., Feuerriegel, S., & Saar‐Tsechansky, M. (2022) · Production and Operations Management · doi:10.1111/poms.13839 · Cited by 90 · see citing works
“In the criminal justice system, differential adherence has been shown to exacerbate disparities in incarceration across Black and White defendants (Albright, 2019), and across socioeconomic brackets (Skeem et al., 2020).”
BackgroundGreen, B., & Chen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479562 · Cited by 69 · see citing works
The impact of AI errors in a human-in-the-loop process
Agudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00529-3 · Cited by 66 · see citing works
“On the other hand, several empirical studies using similar forensic AI models, seem to suggest the opposite results (Green & Chen, 2019a, 2019b, 2021; Grgic-Hlaca et al., 2019; Portela et al., 2022; Skeem et al., 2020).”
ResultMitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603203 · Cited by 67 · see citing works
Wang, H. E., Landers, M., Adams, R., Subbaswamy, A., Kharrazi, H., Gaskin, D. J., & Saria, S. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac065 · Cited by 63 · see citing works
Algorithmic Risk Assessment in the Hands of Humans
Stevenson, M., & Doleac, J. L. (2019) · doi:10.2139/ssrn.3489440 · Cited by 60 · see citing works
“A vignette study conducted on a sample of practicing judges shows that risk assessment use increased socioeconomic disparities in sentencing, potentially by triggering negative stereotypes about poor people (Skeem et al., 2019).”
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603207 · Cited by 49 · see citing works
Algorithmic Risk Assessment in the Hands of Humans
Stevenson, M., & Doleac, J. L. (2020) · doi:10.2139/ssrn.3513695 · Cited by 42 · see citing works
van Eijk, G. (2020) · The British Journal of Criminology · doi:10.1093/bjc/azaa012 · Cited by 12 · see citing works
Imai, K., Jiang, Z., Greiner, D. J., Halen, R., & Shin, S. (2023) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnad010 · Cited by 42 · see citing works
“…impacts of risk assessment scores on judges’ decisions are based on either observational data or hypothetical vignettes in surveys (e.g., Albright, 2019; Berk, 2017; Garrett & Monahan, 2020; Green & Chen, 2019; Miller & Maloney, 2013; Skeem et al., 2020; Stevenson, 2018; Stevenson & Doleac, 2021).”
BackgroundThe Flaws of Policies Requiring Human Oversight of Government Algorithms
Green, B. (2021) · doi:10.2139/ssrn.3921216 · Cited by 259 · see citing works
Misplaced Trust: Measuring the Interference of Machine Learning in Human Decision-Making
Suresh, H., Lao, N., & Liccardi, I. (2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 28 · see citing works
COVID-19 amplified racial disparities in the US criminal legal system
Klein, B., Ogbunugafor, C. B., Schafer, B. J., Bhadricha, Z., Kori, P., Sheldon, J., Kaza, N., Sharma, A., Wang, E. A., Eliassi‐Rad, T., et al. (2023) · Nature · doi:10.1038/s41586-023-05980-2 · Cited by 25 · see citing works
Algorithmic Risk Assessment in the Hands of Humans
Stevenson, M. T., & Doleac, J. L. (2024) · American Economic Journal Economic Policy · doi:10.1257/pol.20220620 · Cited by 24 · see citing works
Johnson, G. M. (2023) · Journal of Moral Philosophy · doi:10.1163/17455243-20234372 · Cited by 24 · see citing works
Policing based on automatic facial recognition
Guo, Z., & Kennedy, L. (2022) · Artificial Intelligence and Law · doi:10.1007/s10506-022-09330-x · Cited by 20 · see citing works
“They may selectively follow the model output according to their own biases, thus amplifying discrimination (Skeem et al. 2020).”
BackgroundThe Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20 · see citing works
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 21 · see citing works
Online Content Moderation: Does Justice Need a Human Face?
Katsaros, M., Kim, J., & Tyler, T. R. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2210879 · Cited by 16 · see citing works
“This movement has led to alarm about the possible impact these algorithms might have on the legitimacy of the legal system, to the various parties involved in the cases, as well as the general public (Skeem et al., 2020).”
BackgroundHughes, J. S., Sandel, A., Yelderman, L. A., & Inman, V. (2021) · Basic and Applied Social Psychology · doi:10.1080/01973533.2021.1982714 · Cited by 8 · see citing works
Algorithmic Risk Scoring and Welfare State Contact Among US Children
Eiermann, M. (2024) · Sociological Science · doi:10.15195/v11.a26 · Cited by 7 · see citing works
“…intractable social inequalities and pervasive discrimination have spurred enthusiasm about technological innovations but have also generated pushback against the algorithmically-augmented surveillance of marginalized communities (Eubanks 2017; Stevenson 2018; Skeem, Scurich, and Monahan 2020).”
BackgroundInfluentialJudicial Decision-Making. A Survey of the Experimental EvidencePreprint
Engel, C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4199122 · Cited by 6 · see citing works
Moreno, Á. M. M. (2021) · IUS ET SCIENTIA · doi:10.12795/ietscientia.2021.i02.05 · Cited by 4 · see citing works
Disciplining Deliberation: A Socio-technical Perspective on Machine Learning Trade-Offs
Fazelpour, S. (2025) · The British Journal for the Philosophy of Science · doi:10.1086/734552 · Cited by 4 · see citing works
The Societal Impacts of Algorithmic Decision-Making
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195 · Cited by 4 · see citing works
Ulbricht, L. (2020) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783748904076-253 · Cited by 3 · see citing works
Williams, J. H., Vaughn, P. E., & Vogel, M. (2024) · Punishment & Society · doi:10.1177/14624745241308582 · Cited by 3 · see citing works
“…shown that defendant socioeconomic status can in fl uence criminal legal system treatment, even when attempts are made to lower court actor discretion (e.g. Skeem et al., 2020), the current study suggests that aggregate factors may also be operating to perpetuate racial and ethnic disparities.”
Sode, K. (2026) · AI & Society · doi:10.1007/s00146-026-02885-2 · Cited by 4 · see citing works
“…propositions: (1) risk information can shift sentencing decisions in systematic ways (e.g., increasing disparities along socioeconomic lines) (Skeem et al. 2020); and (2) organizational practice can produce non-use or selective adoption of risk instruments (Pruss 2023), which still leaves…”
Yogev, D. (2024) · Criminal Justice and Behavior · doi:10.1177/00938548241307234 · Cited by 5 · see citing works
“Despite the growing use of algorithms to assist in risk assessments (Yogev & Mehozay, 2022), the process remains inherently subjective, rooted in human perception (Skeem et al., 2020; Tonry, 2019).”
Automatisierte Erkennung von Stimme, Sprache und Gesicht
Karaboga, M., Frei, N., Ebbers, F., Rovelli, S., Friedewald, M., & Runge, G. (2022) · vdf Hochschulverlag AG an der ETH Zürich eBooks · doi:10.3218/4141-5 · Cited by 5 · see citing works
Zerilli, J. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197539538.003.0009 · Cited by 4 · see citing works
Big Data Ethics: A Life Cycle Perspective
Vydra, S., Poamă, A., Giest, S. N., Ingrams, A. R., & Klievink, B. (2021) · Erasmus Law Review · doi:10.5553/elr.000190 · Cited by 3 · see citing works
Engel, C. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192898579.013.13 · Cited by 2 · see citing works
Testing the interrelationship between area deprivation and ethnic disparities in sentencing
Pina-Sánchez, J., Morales, A., Guilfoyle, E., Veiga, A., & Geneletti, S. (2025) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.12446 · Cited by 4 · see citing works
Circumventing the Sentencing Grid: Encouraging Downward Departures in Presumptive Prison Cases
Renauer, B., Campbell, C. M., Leymon, M. H., et al. (2023) · Criminal Justice Policy Review · doi:10.1177/08874034221146885 · Cited by 2 · see citing works
“These findings regarding life circumstances were substantiated in a recent experiment by Skeem et al. (2020) that examined how risk information interacted with socioeconomic status in sentencing decisions.”
BackgroundDoes Pretrial Status Explain Racial Disparity in Sentencing Outcomes? A Decomposition Analysis
Galvin, M. A., Hester, R., & Kleiman, M. (2024) · Justice Quarterly · doi:10.1080/07418825.2024.2438791 · Cited by 2 · see citing works
“The list of other possibly omitted variables looms large, potentially including: socioeconomic status (Skeem et al., 2020), demeanor (levenson, 2007), attorney type or quality (Hartley et al., 2010; Williams, 2002), perceptions of internal or external causes (Bridges & Steen, 1998), perceptions of…”
Experimental Investigations of Judicial Decision-Making
Holste, L., & Spamann, H. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009170901.022 · Cited by 7 · see citing works
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603198 · Cited by 2 · see citing works
Predictability of Violent Behaviour and Recidivism
Quattrocolo, S. (2020) · Legal studies in international, european and comparative criminal law · doi:10.1007/978-3-030-52470-8_6 · Cited by 2 · see citing works
Algorithmic Monoculture and Social Welfare
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603211 · Cited by 2 · see citing works
An evaluation of the reliability and quality of expert and novice forensic case formulations
Ryan, T. J. (2020) · Summit (Simon Fraser University) · Cited by 2 · see citing works
Mitigating Bias in Algorithmic Decision-making: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603212 · Cited by 1 · see citing works
The Death Penalty in Jordan: A Critical Examination of its Application and Abolition Debate
Azam, S. A., & Airout, M. (2024) · Pakistan Journal of Criminology · doi:10.62271/pjc.16.3.1007.1022 · Cited by 1 · see citing works
The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasons
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603204 · Cited by 1 · see citing works
COVID-19 amplified racial disparities in the U.S. criminal legal systemPreprint
Klein, B., Ogbunugafor, C. B., Schafer, B. J., et al. (2021) · medRxiv · doi:10.1101/2021.12.14.21267199 · Cited by 1 · see citing works
“Over the last several years, we’ve seen a growing body of scholarly work devoted to identifying problematic and harmful racial and economic biases that arise when algorithmic risk assessment tools are used in practice [50–55].”
BackgroundThe Interrelationship between Area Deprivation and Ethnic Disparities in SentencingPreprint
Pina-Sánchez, J., Geneletti, S., Morales, A., Veiga, A., & Guilfoyle, E. (2023) · doi:10.22541/au.167285885.58658782/v1 · Cited by 1 · see citing works
Supporting Information Integration in Human-AI Augmentation via Reflection on UnobservablesPreprint
De‐Arteaga, M., & Holstein, K. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4884604 · Cited by 1 · see citing works
Behavioral Economics and Court Decision-Making
Teichman, D., & Zamir, E. (2021) · Review of Law & Economics · doi:10.1515/rle-2021-0058 · Cited by 4 · see citing works
Pina-Sánchez, J., Morales, A., Geneletti, S., Veiga, A., Guilfoyle, E., & Pina-Sánchez, J. (2023) · doi:10.22541/au.168897284.40421687/v1
КОМПЛЕКСНІСТЬ СКЛАДУ ДОБРОЧЕСНОСТІ СУДДІВ В КОНТЕКСТІ НОВІТНІХ ТЕНДЕНЦІЙ ПРАВОВОЇ РЕАЛЬНОСТІ
Матвіїв, Р. І. (2023) · Herald of Lviv University of Trade and Economics Law sciences · doi:10.32782/2616-7611-2023-13-04
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603213
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603205
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603196
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603201
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603210
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603214
An Assessment of Racial Disparities in Pretrial Decision-Making Using Misclassification ModelsPreprint
Webb, K. A. H., Riley, S., & Wells, M. T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573255
“These results align with growing evidence that risk assessments are primarily beneficial to white and more affluent defendants and can have the opposite effect, intensifying harm, to Black and indigent defendants (Skeem et al., 2020; Marlowe et al., 2020).”
A life engineering perspective on algorithms, AI, social media, and quantitative metrics
Bigea, G., Mumtaz, M., Portmann, E., et al. (2024) · Informatik-Spektrum · doi:10.1007/s00287-024-01569-9 · Cited by 1 · see citing works
“The author also examines mathematical models used in parole decisions and sentencing Skeem et al. [7], also high-light how these models lack transparency and their potential for bias.”
Tobia, K. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009170901.012
Havle, N. (2025) · Journal of Forensic Psychology Research and Practice · doi:10.1080/24732850.2025.2584270
Mao, R., Lanza‐Kaduce, L., Lyu, L., & Lin, X. (2025) · Asian Journal of Criminology · doi:10.1007/s11417-025-09482-0
“For example, Bushway and Piehl (2001) show that judges often exceed guideline recommendations for serious offenses, and Skeem et al. (2020) find that judges may sentence poor defendants more harshly, even when risk assessments are controlled.”
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603206
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603199
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603200
Skeem, J. L., Montoya, L., & Lowenkamp, C. T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5343174
Self-citationEspinosa, E. M., & Scharenbroch, C. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00244-6 · Cited by 1 · see citing works
Skeem, J. L., Montoya, L., & Lowenkamp, C. T. (2026) · Criminology & Public Policy · doi:10.1111/1745-9133.70015
Self-citationFrom AI Ethics to AI Regulation
Helberger, N., & Banks, I. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009589086.009
Schmitz, A. J., Giacalone, M., & Ortolani, P. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009589086.006
- Authors
- Skeem, J., Scurich, N., & Monahan, J.
- Affiliations
- University of California, Berkeley (US)
- University of California, Irvine (US)
- University of Virginia (US)
- Venue
- Law and Human Behavior
- Published
- 2020-02
- Volume
- 44
- Issue
- 1
- Pages
- 51-59
- ISSN
- 0147-7307 (ISSN-L)
- 1573-661X
- OpenAlex
- W2910148890
- Cited by
- 70
- References
- 0
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 10 · 2023: 28 · 2022: 7 · 2021: 6 · 2020: 6 · 2019: 1
- FWCI
- 15.68
- Type
- journal article
- Language
- en
- Open access
- green
- papers.ssrn.com
- Locations
- Law and Human Behavior (publishedVersion)
- PubMed (publishedVersion)
- SSRN Electronic Journal (submittedVersion)
- Funders
- University of California, Berkeley
- Topics
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Social Sciences › Law › Criminal Justice and Penology
- Keywords
- risk assessment tools, sentencing, socioeconomic status, sentencing disparities, incarceration, risk perception, culpability, recidivism prediction, case vignettes
- MeSH terms
- Algorithms, Criminal Law, Decision Making, Female, Humans, Male, Social Class, United States, Risk Assessment, Judicial Role
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review