The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
RISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*
Open accessAbstract
One way to unwind mass incarceration without compromising public safety is to use risk assessment instruments in sentencing and corrections. Although these instruments figure prominently in current reforms, critics argue that benefits in crime control will be offset by an adverse effect on racial minorities. Based on a sample of 34,794 federal offenders, we examine the relationships among race, risk assessment [the Post Conviction Risk Assessment (PCRA)], and future arrest. First, application of well‐established principles of psychological science revealed little evidence of test bias for the PCRA—the instrument strongly predicts arrest for both Black and White offenders, and a given score has essentially the same meaning—that is, the same probability of recidivism—across groups. Second, Black offenders obtain higher average PCRA scores than do White offenders (d = .34; 13.5 percent nonoverlap in groups’ scores), so some applications could create disparate impact. Third, most (66 percent) of the racial difference in PCRA scores is attributable to criminal history—which is already embedded in sentencing guidelines. Finally, criminal history is not a proxy for race, but instead it mediates the relationship between race and future arrest. Data are more helpful than rhetoric if the goal is to improve practice at this opportune moment in history.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 79,882
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
The standards for educational and psychological testing.
Eignor, D. R. (2013) · American Psychological Association eBooks · doi:10.1037/14047-013 · Cited by 6,985
Regression standard errors in clustered samples
Rogers, W. H. (1993) · Stata technical bulletin · Cited by 2,694
National Conference of State Legislatures
Clink, K. (2011) · Reference Reviews · doi:10.1108/09504121111114072 · Cited by 2,310
Kraemer, H. C., Stice, E., Kazdin, A., Offord, D., & Kupfer, D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.6.848 · Cited by 1,712
Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
Rice, M. E., & Harris, G. T. (2005) · Law and Human Behavior · doi:10.1007/s10979-005-6832-7 · Cited by 1,608 · cited 1×
“Minimum AUCs of .56, .64, and .71 correspond to “small,” “medium,” and “large” effect sizes, respectively (see Rice and Harris, 2005).”
STEFFENSMEIER, D., ULMER, J., & KRAMER, J. (1998) · Criminology · doi:10.1111/j.1745-9125.1998.tb01265.x · Cited by 1,592
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Bias and equivalence in cross-cultural assessment: an overview
van de Vijver, F., & Tanzer, N. K. (2004) · European Review of Applied Psychology · doi:10.1016/j.erap.2003.12.004 · Cited by 1,097
Research Commentary —Too Big to Fail: Large Samples and the p -Value Problem
Lin, M., Lucas, H. C., & Shmueli, G. (2013) · Information Systems Research · doi:10.1287/isre.2013.0480 · Cited by 972
Monahan, J. T., Steadman, H. J., Appelbaum, E. S. P. S., Robbins, P. C., Mulvey, E. P., Roth, L. H., Grisso, T., & Banks, S. M. (2001) · doi:10.1093/oso/9780195138825.001.0001 · Cited by 919
Moderator variables: A clarification of conceptual, analytic, and psychometric issues
Arnold, H. J. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90254-9 · Cited by 693
TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGES
Cleary, T. A. (1968) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1968.tb00613.x · Cited by 658
Developmental risk factors for youth violence
Herrenkohl, T. I., Maguin, E., Hemphill, S. A., Hawkins, J. D., Abbott, R. D., & Catalano, R. F. (2000) · Journal of Adolescent Health · doi:10.1016/s1054-139x(99)00065-8 · Cited by 645
Against Prediction: Profiling, Policing, and Punishing in an Actuarial Age
Harcourt, B. E. (2007) · bepress Legal Repository · Cited by 599
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
Recent Developments and New Directions in Sentencing Research
Ulmer, J. T. (2011) · Justice Quarterly · doi:10.1080/07418825.2011.624115 · Cited by 449
The Color of Justice: Race, Ethnicity, and Crime in America
Walker, S., Spohn, C., & DeLone, M. A. (1999) · Cited by 415
Sackett, P. R., Schmitt, N., Ellingson, J. E., & Kabin, M. B. (2001) · American Psychologist · doi:10.1037/0003-066x.56.4.302 · Cited by 387
Decisionmaking in Criminal Justice: Toward the Rational Exercise of Discretion
Jacoby, J. E., Gottfredson, M. R., & Gottfredson, D. M. (1981) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143262 · Cited by 337
ROTH, P. L., BEVIER, C. A., BOBKO, P., SWITZER, F. S., & TYLER, P. (2001) · Personnel Psychology · doi:10.1111/j.1744-6570.2001.tb00094.x · Cited by 325
Principles for the Validation and Use of Personnel Selection Procedures
Anonymous (2018) · Industrial and Organizational Psychology · doi:10.1017/iop.2018.195 · Cited by 316
Research on Sentencing: The Search for Reform
Harris, D. J., Blumstein, A., Cohen, J., Martin, S. B., & Tonry, M. (1984) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143656 · Cited by 307
Decision Making in Criminal Justice
(1988) · Springer eBooks · doi:10.1007/978-1-4757-9954-5 · Cited by 300
Decision Making, in Criminal Justice
Greene, E., & Ellis, L. (2007) · Wiley eBooks · doi:10.1002/9780470713068.ch11 · Cited by 295
Evaluating the predictive validity of the COMPAS risk and needs assessment system
Brennan, T., Dieterich, W., & Ehret, B. (2009) · Criminal Justice and Behavior · doi:10.1177/0093854808326545 · Cited by 272
Juvenile Crime, Juvenile Justice
National Research Council and Institute of Medicine (2001) · National Academies Press eBooks · doi:10.17226/9747 · Cited by 270
Effects of Cognitive-Behavioral Programs for Criminal Offenders
Lipsey, M. W., Landenberger, N. A., & Wilson, S. J. (2007) · Campbell Systematic Reviews · doi:10.4073/csr.2007.6 · Cited by 268
Risk Assessment With Young Offenders
Olver, M., Stockdale, K. C., & Wormith, J. (2009) · Criminal Justice and Behavior · doi:10.1177/0093854809331457 · Cited by 266
Ryan, A. M., & Ployhart, R. E. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115134 · Cited by 260
Risk Assessment in Criminal Sentencing
Monahan, J., & Skeem, J. L. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-092945 · Cited by 256
Self-citationMorris, N. (1973) · Australian & New Zealand Journal of Criminology · doi:10.1177/000486587300600402 · Cited by 255
The color of justice: race, ethnicity, and crime in America
Brooklier, N. (2016) · Journal of Criminal Justice Education · doi:10.1080/10511253.2016.1257416 · Cited by 253
Sackett, P. R., Borneman, M. J., & Connelly, B. S. (2008) · American Psychologist · doi:10.1037/0003-066x.63.4.215 · Cited by 233
Rethinking Risk Assessment: The MacArthur Study of Mental Disorder and Violence
(2001) · PsycEXTRA Dataset · doi:10.1037/e409472005-014 · Cited by 232
Harcourt, B. E. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.237 · Cited by 210
Standardized Instruments For Assessing Risk And Need In Youthful Offenders
Hoge, R. D. (2002) · Criminal Justice and Behavior · doi:10.1177/009385480202900403 · Cited by 202
The Malign Effects of Drug and Crime Control Policies on Black Americans
Tonry, M., & Melewski, M. (2008) · Crime and Justice · doi:10.1086/588492 · Cited by 202
Singh, J. P., & Fazel, S. (2010) · Criminal Justice and Behavior · doi:10.1177/0093854810374274 · Cited by 181
The Oxford Handbook of Sentencing and Corrections
Petersilia, J. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199730148.001.0001 · Cited by 177
Principles for the Validation and Use of Personnel Selection Procedures
Tippins, N. T. (2004) · PsycEXTRA Dataset · doi:10.1037/e633072007-001 · Cited by 176
Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2011.8 · Cited by 173
Evidence-Based Sentencing and the Scientific Rationalization of Discrimination
Starr, S. B. (2013) · bepress Legal Repository · Cited by 163
Wilson, H. A., & Gutierrez, L. (2013) · Criminal Justice and Behavior · doi:10.1177/0093854813500958 · Cited by 160
Marriage and divorce: patterns by gender, race, and educational attainment
Aughinbaugh, A., Robles, O. J., & Sun, H. (2013) · Monthly labor review · doi:10.21916/mlr.2013.32 · Cited by 158
Piquero, A. R., & Brame, R. W. (2008) · Crime & Delinquency · doi:10.1177/0011128707307219 · Cited by 150
A Cautionary Note on the Use of Actuarial Risk Assessment Tools for Social Control
Silver, E., & Miller, L. L. (2002) · Crime & Delinquency · doi:10.1177/0011128702048001006 · Cited by 142
Are there ethnic differences in levels of psychopathy? A meta-analysis.
Skeem, J. L., Edens, J. F., Camp, J., & Colwell, L. H. (2004) · Law and Human Behavior · doi:10.1023/b:lahu.0000046431.93095.d8 · Cited by 137
Self-citationPerformance of recidivism risk assessment instruments in U.S. correctional settings.
Desmarais, S. L., Johnson, K. L., & Singh, J. P. (2016) · Psychological services · doi:10.1037/ser0000075 · Cited by 132
Standardized Instruments For Assessing Risk And Need In Youthful Offenders
Hoge, R. D. (2002) · Criminal Justice and Behavior · doi:10.1177/0093854802029004003 · Cited by 131
Risk Redux: The Resurgence of Risk Assessment in Criminal Sanctioning
Monahan, J. T., & Skeem, J. L. (2014) · Federal Sentencing Reporter · doi:10.1525/fsr.2014.26.3.158 · Cited by 115
Self-citationJust sentencing: principles and procedures for a workable system
(2013) · Choice Reviews Online · doi:10.5860/choice.51-2931 · Cited by 112
What Explains Persistent Racial Disproportionality in Minnesota’s Prison and Jail Populations?
Frase, R. S. (2009) · Crime and Justice · doi:10.1086/599199 · Cited by 107
Bias in Psychological Assessment: An Empirical Review and Recommendations
Reynolds, C. R., & Ramsay, M. C. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei1004 · Cited by 103
Ulmer, J. T., Painter‐Davis, N., & Tinik, L. A. (2014) · Justice Quarterly · doi:10.1080/07418825.2014.958186 · Cited by 103
Legal and Ethical Issues in the Prediction of Recidivism
Tonry, M. (2013) · Federal Sentencing Reporter · doi:10.1525/fsr.2014.26.3.167 · Cited by 98
Constructing Actuarial Devices for Predicting Recidivism
Silver, E., Smith, W. R., & Banks, S. M. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027006004 · Cited by 88
Juvenile crime, juvenile justice - Panel on juvenile crime: Prevention, treatment and control
Ferrall, B. (2001) · The Journal of Criminal Law and Criminology (1973-) · Cited by 85
Understanding Race/Ethnicity Differences in Offending Across the Life Course: Gaps and Opportunities
Piquero, A. R. (2015) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-015-0004-3 · Cited by 82
Previous Convictions at Sentencing : Theoretical and Applied Perspectives
(2010) · Hart Publishing eBooks · doi:10.5040/9781472565150 · Cited by 78
Methods for Detecting and Evaluating Cultural Bias in Neuropsychological Tests
Reynolds, C. R. (2000) · Critical issues in neuropsychology · doi:10.1007/978-1-4615-4219-3_15 · Cited by 73
Confidence Intervals for the Overlapping Coefficient: the Normal Equal Variance Case
Reiser, B., & Faraggi, D. (1999) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.00199 · Cited by 73
Juvenile Crime, Juvenile Justice. Panel on Juvenile Crime: Prevention, Treatment, and Control.
McCord, J., Widom, C. S., & Crowell, N. A. (2001) · Cited by 71
Walters, G. D., & Lowenkamp, C. T. (2015) · Psychological Assessment · doi:10.1037/pas0000210 · Cited by 66
Self-citationNellis, A. M., Greene, J. A., & Mauer, M. (2008) · Cited by 66
Criminal History Enhancements Sourcebook
Frase, R. S., Roberts, J. R., Hester, R., & Mitchell, K. L. (2015) · Cited by 62
Walters, G. D. (2011) · Law and Human Behavior · doi:10.1037/h0093928 · Cited by 57
The federal Post Conviction Risk Assessment (PCRA): A construction and validation study.
Lowenkamp, C. T., Johnson, J. L., Holsinger, A. M., VanBenschoten, S. W., & Robinson, C. R. (2012) · Psychological Services · doi:10.1037/a0030343 · Cited by 53
Self-citationRacial Disparities In Involuntary Outpatient Commitment: Are They Real?
Swanson, J. W., Swartz, M. S., Dorn, R. A. V., Monahan, J. T., McGuire, T. G., Steadman, H. J., & Robbins, P. C. (2009) · Health Affairs · doi:10.1377/hlthaff.28.3.816 · Cited by 47
Cohen, T. H., Lowenkamp, C. T., & VanBenschoten, S. W. (2016) · Criminology & Public Policy · doi:10.1111/1745-9133.12190 · Cited by 47
Self-citationRacial Disproportionality of U.S. Prison Populations Revisited
Blumstein, A. (1993) · eYLS (Yale Law School) · Cited by 47
PCRA revisited: Testing the validity of the Federal Post Conviction Risk Assessment (PCRA).
Lowenkamp, C. T., Holsinger, A. M., & Cohen, T. H. (2015) · Psychological Services · doi:10.1037/ser0000024 · Cited by 46
Self-citationThe construction and validation of the Federal Post Conviction Risk Assessment (PCRA).
Johnson, J. L., Lowenkamp, C. T., Benschotem, S. W. V., & Robinson, C. R. (2011) · Federal probation · Cited by 43
Self-citationThe Role of Race in Forecasts of Violent Crime
Berk, R. (2009) · Race and Social Problems · doi:10.1007/s12552-009-9017-z · Cited by 41
Using Risk Assessment to Inform Sentencing Decisions for Nonviolent Offenders in Virginia
Kleiman, M., Ostrom, B. J., & Cheesman, F. L. (2006) · Crime & Delinquency · doi:10.1177/0011128706294442 · Cited by 40
Cohen, T. H., & VanBenschoten, S. W. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2463376 · Cited by 34
Guideline-Based Justice: Prediction and Racial Minorities
Petersilia, J., & Turner, S. F. (1987) · Crime and Justice · doi:10.1086/449134 · Cited by 31
Starr, S. B. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.229 · Cited by 30
Bureau of Justice Statistics (BJS)
Davis, M. S. (2002) · Sage eBooks · doi:10.4135/9781452229300.n268 · Cited by 27
Holder, E. H. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.252 · Cited by 25
van Wingerden, S., van Wilsem, J., & Moerings, M. (2014) · European Journal of Criminology · doi:10.1177/1477370814525937 · Cited by 23
Race, Gender, and Guidelines-Based Decision Making
Gottfredson, S. D., & Jarjoura, G. R. (1996) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427896033001004 · Cited by 20
Supreme Court Decision: Griggs vs. Duke Power Co
(1971) · PsycEXTRA Dataset · doi:10.1037/e568792009-005 · Cited by 20
Race And Crime: A Biosocial Analysis
Walsh, A. (2004) · Scholar Works (Boise State University) · Cited by 19
Guideline-Based Justice: The Implications for Racial Minorities
Petersilia, J., & Turner, S. F. (1985) · Cited by 15
Forensic Risk Assessment: A MetareviewPreprint
Singh, J. P., & Fazel, S. (2010) · SSRN Electronic Journal · Cited by 14
Frase, R. S. (2014) · Federal Sentencing Reporter · doi:10.1525/fsr.2014.26.3.145 · Cited by 10
National Conference of State Legislatures, D. (1983) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/893024 · Cited by 9
Federal Sentencing Disparity: 2005-2012 (Summary)
Statistics, U. S. B. O. J. (2016) · Federal Sentencing Reporter · doi:10.1525/fsr.2016.28.3.195 · Cited by 9
Conceptual and Technical Issues in Conducting and Interpreting Differential Prediction Analyses
Sackett, P. R., & Bobko, P. (2010) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2010.01226.x · Cited by 7
Cohen, T. H., Lowenkamp, C. T., & VanBenschoten, S. W. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2621267 · Cited by 6
Self-citationRace, Ethnicity, and Punishment
Tonry, M. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199730148.013.0002 · Cited by 6
CCMATCH: Stata module to match cases and controls using specified variables
Cook, D. E. (2011) · RePEc: Research Papers in Economics · Cited by 2
Research works printed but not linked: 16
- American Law Institute, 2014, Model Penal Code: Sentencing (Tentative Draft No. 3)
- Arnold John, 2015, Fixing justice in America, Politico Magazine
- Blumstein Alfred, 1993, Racial disproportionality of US prison populations revisited, University of Colorado Law Review, 64, 743
- Carson Elizabeth, 2015, Prisoners in 2014
- Durose Matthew, 2014, Recidivism of Prisoners Released in 30 States in 2005: Patterns from 2005 to 2010
- Elek Warren, 2015, Using Risk and Needs Assessment Information at Sentencing: Observations from Ten Jurisdictions
- Ender Philip, 2011, Binary_mediation: Command to Compute Indirect Effect with Binary Mediator and/or Binary Response Variable
- Flores Anthony, Comparing variable and fixed follow‐up outcome periods: Do different methods produce different results?, Criminal Justice and Behavior
- Frase Richard, 2004, The Future of Imprisonment
- Frase Richard, 2009, Crime and Justice
- Lawrence Alison, 2013, Trends in Sentencing and Corrections: State Legislation
- Lowenkamp Christopher T., 2007, Predictive validity of the LSI‐R on a sample of offenders drawn from the records of the Iowa Department of Correction Data Management System, Federal Probation, 71, 25
- Reynolds Cecil R., 2012, Handbook of Psychology, Vol 10, Assessment Psychology
- Sentencing Project News, 2015, Race & Justice News: Risk Assessment or Race Assessment?
- Subramanian Ram, 2014, Recalibrating Justice: A Review of 2013 State Sentencing and Corrections Trends
- Tonry Michael, 2008, In Crime and Justice
Cited by
Sorted by citations
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Ethical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687
Ethical and Bias Considerations in Artificial Intelligence/Machine Learning
Hanna, M. G., Pantanowitz, L., Jackson, B., Palmer, O., Visweswaran, S., Pantanowitz, J., Deebajah, M., & Rashidi, H. H. (2025) · Modern Pathology · doi:10.1016/j.modpat.2024.100686 · Cited by 535
Metadata
- Authors
- SKEEM, J. L., & LOWENKAMP, C. T.
- Affiliations
- University of California, Berkeley (US)
- United States Courts (US)
- Corresponding author
- SKEEM, JENNIFER L.
- Venue
- Criminology
- Publisher
- Wiley
- Published
- 2016-11
- Volume
- 54
- Issue
- 4
- Pages
- 680-712
- ISSN
- 0011-1384 (ISSN-L)
- 1745-9125
- OpenAlex
- W2546836975
- Semantic Scholar
- de4710c8041180b968ada83c5bc4262232953e8f
- Cited by
- 317
- References
- 96
- Citations by year
- 2026: 23 · 2025: 29 · 2024: 34 · 2023: 24 · 2022: 47 · 2021: 49 · 2020: 42 · 2019: 24 · 2018: 24 · 2017: 12 · 2016: 7
- FWCI
- 35.80
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Criminology (publishedVersion)
- SSRN Electronic Journal (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- risk assessment tools, predictive bias, indirect discrimination, recidivism, race, criminal history, federal offenders, mass incarceration, sentencing guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review