Racist Algorithms or Systemic Problems? Risk Assessments and Racial Disparities
Abstract
As recent and historical events attest, racial and ethnic disparities are widely engrained into the justice system. Recently, scholars and policymakers have raised concerns that risk assessment instruments may exacerbate these disparities. While it is critical that risk instruments be scrutinized for racial bias, some concerns, though well-meaning, have gone beyond the evidence. This article explains what it means for an instrument to be “biased” and why instruments should not all be painted with the same brush (some will be more susceptible to bias than others). If some groups get apprehended more, those groups will score higher on non-biased, well-validated instruments derived to maximize prediction of recidivism because of mathematics. Thus, risk instruments shine a light on long-standing systemic problems of racial disparities. This article concludes with suggestions for research and for minimizing disparities by ensuring that systems use risk assessments to avoid unnecessary incarceration while allowing for structured discretion.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Psychologists have drawn attention to the need for careful consideration of inherent bias in some risk assessment tools, particularly those that are based almost entirely on one's prior criminal record.
“Psychologists have drawn attention to the need for careful consideration of inherent bias in some risk assessment tools, particularly those that are based almost entirely on one ' s prior criminal record (e.g., Vincent & Viljoen, 2020).”
From A call to dismantle systemic racism in criminal legal systems. (2022) · cites this paper as Vincent & Viljoen, 2020
Cites
The standards for educational and psychological testing.
Eignor, D. R. (2013) · American Psychological Association eBooks · doi:10.1037/14047-013 · Cited by 6,975 · see citing works
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · see citing works
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640 · see citing works
The accuracy, fairness, and limits of predicting recidivism
Dressel, J., & Farid, H. (2018) · Science Advances · doi:10.1126/sciadv.aao5580 · Cited by 1,071 · see citing works
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · see citing works
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological bulletin · doi:10.1037/a0020473 · Cited by 708 · see citing works
Bridges, G. S., & Steen, S. (1998) · American Sociological Review · doi:10.2307/2657267 · Cited by 661 · see citing works
The Prediction of Violence in Adult Offenders
Campbell, M. A., French, S. A., & Gendreau, P. (2009) · Criminal Justice and Behavior · doi:10.1177/0093854809333610 · Cited by 432 · see citing works
Priming unconscious racial stereotypes about adolescent offenders.
Graham, S., & Lowery, B. S. (2004) · Law and Human Behavior · doi:10.1023/b:lahu.0000046430.65485.1f · Cited by 313 · see citing works
Olver, M., Stockdale, K. C., & Wormith, J. (2014) · Psychological Assessment · doi:10.1037/a0035080 · Cited by 264 · see citing works
Flores, A. W., Bechtel, K., & Lowenkamp, C. T. (2016) · Federal probation · Cited by 244 · see citing works
Perlman, I. R. (1965) · Juvenile Court Judges Journal · doi:10.1111/j.1755-6988.1965.tb01349.x · Cited by 242 · see citing works
Risk, Race, and Recidivism: Predictive Bias and Disparate Impact
Skeem, J., & Lowenkamp, C. T. (2016) · Criminology · doi:10.1111/1745-9125.12123 · Cited by 217 · see citing works
Harcourt, B. E. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.237 · Cited by 210 · see citing works
Mental Health Screening and Assessment in Juvenile Justice
Arredondo, D. E. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.7.1048-a · Cited by 124 · see citing works
The limits of human predictions of recidivism
Lin, Z. J., Jung, J., Goel, S., & Skeem, J. (2020) · Science Advances · doi:10.1126/sciadv.aaz0652 · Cited by 124 · see citing works
Risk-Needs Assessment in Juvenile Justice
Vincent, G. M., Chapman, J., & Cook, N. E. (2010) · Criminal Justice and Behavior · doi:10.1177/0093854810386000 · Cited by 95 · see citing works
Self-citationEisenberg, M., van Horn, J. V., Dekker, J., Assink, M., van der Put, C. E., Hendriks, J., & Stams, G. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854819826109 · Cited by 85 · see citing works
Culture and violence risk assessment: The case of Ewert v. Canada
Hart, S. D. (2016) · Journal of Threat Assessment and Management · doi:10.1037/tam0000068 · Cited by 82 · see citing works
Loeber, R., Farrington, D. P., Hipwell, A. E., Stepp, S. D., Pardini, D. A., & Ahonen, L. (2015) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-015-0010-5 · Cited by 75 · see citing works
Violence Risk and Race in a Sample of Youth in Juvenile Detention
Chapman, J., Desai, R. A., Falzer, P. R., & Borum, R. (2006) · Youth Violence and Juvenile Justice · doi:10.1177/1541204006286316 · Cited by 66 · see citing works
Viljoen, J. L., Jonnson, M. R., Cochrane, D. M., Vargen, L. M., & Vincent, G. M. (2019) · Law and Human Behavior · doi:10.1037/lhb0000344 · Cited by 64 · see citing works
Self-citationNorth Carolina Assessment of Risk (NCAR)
Schwalbe, C. S. J., Fräser, M. W., Day, S. H., & Arnold, E. M. (2004) · Journal of Offender Rehabilitation · doi:10.1300/j076v40n01_01 · Cited by 61 · see citing works
Are Risk Assessments Racially Biased?: Field Study of the SAVRY and YLS/CMI in Probation
Perrault, R. T., Vincent, G., & Guy, L. (2017) · Psychological Assessment · doi:10.1037/pas0000445 · Cited by 61 · see citing works
Self-citationRisk Assessment and Juvenile Justice
Campbell, C., Papp, J., Barnes, A. R., Onifade, E., & Anderson, V. R. (2018) · Criminology & Public Policy · doi:10.1111/1745-9133.12377 · Cited by 55 · see citing works
Using algorithms to address trade-offs inherent in predicting recidivism.
Skeem, J., & Lowenkamp, C. T. (2020) · Behavioral sciences & the law · doi:10.1002/bsl.2465 · Cited by 54 · see citing works
Predictive Validity of the Joint Risk Matrix With Juvenile Offenders
Schwalbe, C. S. J., Fräser, M. W., & Day, S. H. (2007) · Criminal Justice and Behavior · doi:10.1177/0093854806292244 · Cited by 53 · see citing works
Muir, N. M., Viljoen, J. L., Jonnson, M. R., Cochrane, D. M., & Rogers, B. J. (2020) · Psychological Assessment · doi:10.1037/pas0000816 · Cited by 41 · see citing works
Self-citationRevalidation of the Federal PTRA: Testing the PTRA for Predictive Biases
Cohen, T. H., & Lowenkamp, C. T. (2018) · Criminal Justice and Behavior · doi:10.1177/0093854818810315 · Cited by 25 · see citing works
Holder, E. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.252 · Cited by 24 · see citing works
Textbook of Violence Assessment and Management
Buchanan, A. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.10.1222 · Cited by 24 · see citing works
Reliability and Validity of START and LSI-R Assessments in Mental Health Jail Diversion Clients
Lowder, E. M., Desmarais, S. L., Rade, C. B., Johnson, K. L., & Dorn, R. A. V. (2017) · Assessment · doi:10.1177/1073191117704505 · Cited by 23 · see citing works
Differential Racial/Ethnic Predictive Validity
Rembert, D. A., Henderson, H., & Pirtle, D. (2013) · Youth Violence and Juvenile Justice · doi:10.1177/1541204013485606 · Cited by 22 · see citing works
Starr, S. B. (2015) · Federal Sentencing Reporter · doi:10.1525/fsr.2015.27.4.205 · Cited by 11 · see citing works
Rohwer, R., Wynne-Johns, M., & Wysotzki, F. (1994) · Fraunhofer-Publica (Fraunhofer-Gesellschaft) · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Digital Ecosystems, Children, and Adolescents: Policy Statement
Munzer, T. G., Parga-Belinkie, J., Milkovich, L. M., Tomopoulos, S., Ajumobi, T., Cross, C., Gerwin, R. L., Madigan, S. L., Psych, R., Radesky, J. S., et al. (2026) · PEDIATRICS · doi:10.1542/peds.2025-075320 · Cited by 68 · see citing works
The Empirical Case for Pretrial Risk Assessment Instruments
Desmarais, S. L., Monahan, J. T., & Austin, J. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211041651 · Cited by 34 · see citing works
It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness BenchmarksPreprint
Bao, M., Zhou, A., Zottola, S. A., Brubach, B., Desmarais, S. L., Horowitz, A., Lum, K., & Venkatasubramanian, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05498 · Cited by 62 · see citing works
Viljoen, J. L., Goossens, I., Monjazeb, S., Cochrane, D. M., Vargen, L. M., Jonnson, M. R., Blanchard, A. J. E., Li, S. M. Y., & Jackson, J. R. (2024) · Behavioral Sciences & the Law · doi:10.1002/bsl.2698 · Cited by 33 · see citing works
Self-citationViolence Risk Assessment and Management
Hart, S. D., & Douglas, K. S. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197649138.013.18 · Cited by 25 · see citing works
A call to dismantle systemic racism in criminal legal systems.
Najdowski, C. J., & Stevenson, M. C. (2022) · Law and Human Behavior · doi:10.1037/lhb0000510 · Cited by 21 · see citing works
Lowder, E., Diaz, C. L., Grommon, E., & Ray, B. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-021-09492-9 · Cited by 16 · see citing works
Algorithmic gender bias: investigating perceptions of discrimination in automated decision-making
Kim, S., Oh, P., & Lee, J. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2306484 · Cited by 21 · see citing works
Batastini, A. B., Jones, A. C. T., Patel, M. B., & Pringer, S. M. (2022) · Criminal Justice and Behavior · doi:10.1177/00938548221074369 · Cited by 14 · see citing works
Besio, C., Fedtke, C., Grothe‐Hammer, M., Karafillidis, A., & Pronzini, A. (2024) · Systems Research and Behavioral Science · doi:10.1002/sres.3028 · Cited by 15 · see citing works
Lowder, E. M., Kamara, Z. B., & Kent, A. (2023) · Criminal Justice and Behavior · doi:10.1177/00938548231177709 · Cited by 9 · see citing works
Pretrial Risk Assessment, Release Recommendations, and Racial Bias
Zottola, S. A., Desmarais, S. L., Stewart, D. K., Clarke, S. E. D., & Monahan, J. T. (2023) · Criminal Justice and Behavior · doi:10.1177/00938548231174908 · Cited by 8 · see citing works
Hughes, J. S., Sandel, A., Yelderman, L. A., & Inman, V. (2021) · Basic and Applied Social Psychology · doi:10.1080/01973533.2021.1982714 · Cited by 8 · see citing works
Examining Case Dismissal Outcomes in Prosecutor-Led Diversion Programs
Epperson, M. W., Sawh, L., Patel, S. Y., Pettus‐Davis, C., & Grier, A. (2022) · Criminal Justice Policy Review · doi:10.1177/08874034221138738 · Cited by 8 · see citing works
Predictive Bias in Juvenile Risk Assessment: Considering Race/Ethnicity and Sex
Childs, K. K., Peck, J. H., & Brady, C. M. (2022) · Crime & Delinquency · doi:10.1177/00111287221143936 · Cited by 10 · see citing works
Artificial Intelligence in Violence Risk Assessment: Addressing Racial Bias and Inequity
Ratajczak, R., & Cockerill, R. G. (2023) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000713 · Cited by 9 · see citing works
Bail Reform in the United States: The What, Why, and How of Third Wave Efforts
Zottola, S. A., Clarke, S. E. D., & Desmarais, S. L. (2021) · Springer eBooks · doi:10.1007/978-3-030-77565-0_9 · Cited by 7 · see citing works
Anderson, C. N., WOOLDREDGE, J. D., & Cochran, J. C. (2022) · Criminology & Public Policy · doi:10.1111/1745-9133.12576 · Cited by 7 · see citing works
Judicial decision-making in the era of pretrial reform
Foudray, C. M. A., & Lowder, E. M. (2024) · Psychology Crime and Law · doi:10.1080/1068316x.2024.2375225 · Cited by 9 · see citing works
Demichele, M., Silver, I. A., Labrecque, R., Dawes, D., Lattimore, P., & Tueller, S. J. (2024) · Social Science Research Network · doi:10.1177/00938548241233934 · Cited by 7 · see citing works
Sullivan, C. J., McCafferty, J. T., Newsome, J., & Petkus, A. A. (2021) · Journal of Crime and Justice · doi:10.1080/0735648x.2021.1997788 · Cited by 6 · see citing works
Do common risk factors for violence generalize across ethnicity?
Monjazeb, S., & Douglas, K. S. (2022) · Psychology Crime and Law · doi:10.1080/1068316x.2022.2097231 · Cited by 6 · see citing works
Helmus, L. M., Ahmed, S., Lee, S. C., & Olver, M. E. (2024) · Current Psychiatry Reports · doi:10.1007/s11920-023-01480-2 · Cited by 6 · see citing works
Hilton, N. Z., & Radatz, D. L. (2023) · Crime & Delinquency · doi:10.1177/00111287231178679 · Cited by 5 · see citing works
Fix, R. L., Holliday, C. N., Alexander, K. A., & Powell, T. W. (2022) · Archives of Sexual Behavior · doi:10.1007/s10508-022-02466-6 · Cited by 5 · see citing works
Sheppard, K. G., Talaugon, A. R., & Hernandez, J. L. (2024) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2024.102262 · Cited by 4 · see citing works
Just Algorithms: Using Science to Reduce Incarceration and Inform a Jurisprudence of Risk
Slobogin, C. (2021) · Cited by 4 · see citing works
Evaluating Fairness of Algorithmic Risk Assessment Instruments: The Problem With Forcing Dichotomies
Zottola, S. A., Desmarais, S. L., Lowder, E. M., & Clarke, S. E. D. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211040544 · Cited by 4 · see citing works
Jung, S. Y., & Thomas, M. L. (2022) · Sexual Offending Theory Research and Prevention · doi:10.5964/sotrap.8085 · Cited by 4 · see citing works
Verantwortungsvolle Maschinen ohne Verantwortlichkeit? Datenintensive Algorithmen in Organisationen
Besio, C., Fedtke, C., Grothe‐Hammer, M., Karafillidis, A., & Pronzini, A. (2021) · Soziale Systeme · doi:10.1515/sosys-2021-0005 · Cited by 3 · see citing works
Questioning AI: How Racial Identity Shapes the Perceptions of Algorithmic BiasPreprint
Kim, S., Lee, J., & Oh, P. (2023) · doi:10.31234/osf.io/afcdn · Cited by 5 · see citing works
Hogan, N. R., & Corăbian, G. (2025) · Behavioral Sciences & the Law · doi:10.1002/bsl.70014 · Cited by 2 · see citing works
Análise da presença de alunas dos cursos da área de Computação da UFRN
Medeiros, S., & Medeiros, I. G. (2021) · Anais do Women in Information Technology (WIT) · doi:10.5753/wit.2021.15865 · Cited by 2 · see citing works
Clark, V. A. (2022) · Crime & Delinquency · doi:10.1177/00111287221106943 · Cited by 2 · see citing works
Felix, E. R., Gándara, D., & Jones, S. M. (2024) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/01614681241247915 · Cited by 2 · see citing works
Risk assessment for criminal and violent behavior amongst adults
Douglas, K. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91497-0.00208-3 · Cited by 2 · see citing works
DeMichele, M. T., Silver, I. A., Labrecque, R. M., Dawes, D., Lattimore, P. K., & Tueller, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4432449 · Cited by 2 · see citing works
Lord, M., Batastini, A. B., Smith, C. J., Vitacco, M. J., & Eddy, T. (2024) · Behavioral Sciences & the Law · doi:10.1002/bsl.2646 · Cited by 1 · see citing works
Lam, S. S. F., Goossens, I., & Helmus, L. M. (2024) · Journal of Sexual Aggression · doi:10.1080/13552600.2024.2375323 · Cited by 1 · see citing works
Callahan, P. A., Jeglic, E. L., & Calkins, C. (2024) · Sexual Abuse · doi:10.1177/10790632241268471 · Cited by 1 · see citing works
Countering flaws in algorithm design and applications: a Delphi study
Gokhale, A. A. (2024) · AI & Society · doi:10.1007/s00146-024-02124-6 · Cited by 1 · see citing works
MacIsaac, A., Killen, A., & SCHMIDT, F. H. (2025) · Criminal Justice and Behavior · doi:10.1177/00938548251353755 · Cited by 1 · see citing works
Rieger, D. J., Serin, R. C., & Brown, S. L. (2025) · Criminal Justice and Behavior · doi:10.1177/00938548251389465 · Cited by 1 · see citing works
Differential Prediction by Race in IRAS-PAT Assessments: An Application of Debiasing Strategies
Lawson, S. G., & Lowder, E. M. (2022) · Justice Quarterly · doi:10.1080/07418825.2022.2086481 · Cited by 1 · see citing works
Aelick, C. A., Blais, J., & Babchishin, K. M. (2023) · Psychology Crime and Law · doi:10.1080/1068316x.2023.2213388 · Cited by 1 · see citing works
Batastini, A. B., Hoyt, A. A., Horton, J., & Young, B. (2023) · Springer eBooks · doi:10.1007/978-3-031-37480-7_13 · Cited by 1 · see citing works
Proactivity: The Key to Personal and Professional Success
Safer, D. A. (2024) · Eye on Psi Chi Magazine · doi:10.24839/2164-9812.eye28.3.10 · Cited by 1 · see citing works
Christine Montross: Waiting for an Echo: The Madness of American Incarceration
Tudor, C. (2021) · Critical Criminology · doi:10.1007/s10612-021-09553-5 · Cited by 1 · see citing works
Algorithmic Gender Bias: Investigating Perceptions of Discrimination in Automated Decision-MakingPreprint
Kim, S., Oh, P., & Lee, J. (2024) · doi:10.31234/osf.io/zpqrt · Cited by 1 · see citing works
Why are individuals over age 60 still committed as sexually violent persons?
Kahn, R. E., Ambroziak, G., Mundt, J. C., Keiser, K. L., & Thornton, D. (2022) · Behavioral Sciences & the Law · doi:10.1002/bsl.2559
Viljoen, J. L., Li, S. M. Y., Schillaci-Ventura, J., & Cochrane, D. M. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197549513.013.16
Self-citationTraining the 21st Century Clinical Psychologist
Bekerian, D. A. (2024) · Eye on Psi Chi Magazine · doi:10.24839/2164-9812.eye28.3.52
We Are Looking Good for 95... But Wait Until You See Us at 100!
Charlton, S. R. (2024) · Eye on Psi Chi Magazine · doi:10.24839/2164-9812.eye28.3.4
Trial Consulting as a Career? Interview With Robert F. Bettler, Jr., PhD
Cannon, B. (2024) · Eye on Psi Chi Magazine · doi:10.24839/2164-9812.eye28.3.42
DeVall, K. E., Gregory, P. D., & Hartmann, D. J. (2024) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2024.102510
Davis, R. M., Batastini, A. B., Sacco, D. F., Dahlen, E. R., Warlick, C. A., Anumba, N. M., & Young, B. (2024) · Criminal Justice and Behavior · doi:10.1177/00938548241288232
Pacific Islander and Māori Perspectives on Forensic Risk Assessment in Australia
Venner, S., Maharaj, N., Sivasubramaniam, D., & Shepherd, S. M. (2024) · International Journal of Forensic Mental Health · doi:10.1177/14999013241301100
Jones, D. K., & Reisig, M. D. (2024) · Criminal Justice and Behavior · doi:10.1177/00938548241309666 · Cited by 1 · see citing works
Pereira, R., & Ngo, H. V. (2025) · Journal of Criminological Research Policy and Practice · doi:10.1108/jcrpp-01-2024-0006
A Call to Dismantle Systemic Racism in Criminal Legal SystemsPreprint
Najdowski, C. J., & Stevenson, M. C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5145326
Exploring court no-shows: Identifying typologies of failure to appear
McGlynn, C., Campbell, C. M., & Henderson, K. S. (2025) · Journal of Crime and Justice · doi:10.1080/0735648x.2025.2581976
Where evidence ends: opportunities for advancing juvenile justice system research
Soderstrom, M. F. P., Peck, J. H., & Childs, K. K. (2026) · Evidence Base · doi:10.1080/30679125.2026.2643180
Goddard, T., & Havertong, M. D. (2026) · Race and Justice · doi:10.1177/21533687261431759
Psychometric Properties of the LS/CMI Among Men Under Correctional Supervision in New Zealand
Botha, R., Davies, S. T., & Nichols, T. (2026) · Criminal Justice and Behavior · doi:10.1177/00938548261428691
Banasik, M. (2026) · Problems of Forensic Sciences · doi:10.4467/12307483pfs.25.013.23648
Perceptions of artificial intelligence bias and gender inclusivity: toward a gendered divergence
Au, A. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2737402
- Authors
- Vincent, G. M., & Viljoen, J. L.
- Affiliations
- University of Massachusetts Chan Medical School (US)
- Simon Fraser University (CA)
- Corresponding author
- Vincent, Gina M.
- Venue
- Criminal Justice and Behavior
- Publisher
- SAGE Publications
- Published
- 2020-09-10
- Volume
- 47
- Issue
- 12
- Pages
- 1576-1584
- ISSN
- 0093-8548 (ISSN-L)
- 1552-3594
- OpenAlex
- W3085784634
- Cited by
- 68
- References
- 35
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 23 · 2023: 10 · 2022: 13 · 2021: 10
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Criminal Justice and Behavior (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › Artificial Intelligence in Law
- Keywords
- risk assessment tools, racial disparities, algorithmic bias, recidivism prediction, criminal justice system, systemic racism, pretrial detention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review