Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: the clinical -statistical controversy
Abstract
Given a data set about an individual or group (e.g., interviewer ratings, life history or demographic facts, test results, self-descriptions), there are two modes of data combination for a predictive or diagnostic purpose. The clinical method relies on human judgment that is based on informal contemplation and, sometimes, discussion with others (e.g., case conferences). The mechanical method involves a formal, algorithmic, objective procedure (e.g., equation) to reach the decision. Empirical comparisons of the accuracy of the two methods (136 studies over a wide range of predictands) show that the mechanical method is almost invariably equal to or superior to the clinical method: Common antiactuarial arguments are rebutted, possible causes of widespread resistance to the comparative research are offered, and policy implications of the statistical method’s superiority are discussed. In 1928, the Illinois State Board of Parole published a study by sociologist Burgess of the parole outcome for 3,000 criminal offenders, an exhaustive sample of parolees in a period of years preceding. (In Meehl 1954/1996, this number is erroneously reported as 1,000, a slip probably arising from the fact that 1,000 cases came from each of three Illinois prisons.) Burgess combined 21 objective factors (e.g., nature of crime,
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Decisions based on regression are less likely to be subject to bias, they are consistent, the basis for the decisions can be fully explained and they are generally useful.
“As a result, decisions based on regression are less likely to be subject to bias, they are consistent, the basis for the decisions can be fully explained and they are generally useful.”
From Illusions in Regression Analysis (2011) · cites this paper as Grove and Meehl 1996
The gains from regression-based decisions are especially well documented when compared to judgmental decisions based on the same data.
“The gains are especially well documented when compared to judgmental decisions based on the same data (Grove and Meehl 1996; Armstrong 2001).”
From Illusions in Regression Analysis (2011) · cites this paper as Grove and Meehl 1996
Cites
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
Self-citationUnit weighting schemes for decision making
Einhorn, H. J., & Hogarth, R. M. (1975) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(75)90044-6 · Cited by 673 · see citing works
Causes and effects of my disturbing little book
Meehl, P. E. (1986) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5003_6 · Cited by 410 · see citing works
Self-citationWhen shall we use our heads instead of the formula?
Meehl, P. E. (1957) · Journal of Counseling Psychology · doi:10.1037/h0047554 · Cited by 310 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · see citing works
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015 · see citing works
Artificial Intelligence in Utilitarian vs. Hedonic Contexts: The “Word-of-Machine” Effect
Longoni, C., & Cian, L. (2022) · Journal of Marketing · doi:10.1177/0022242920957347 · Cited by 831 · see citing works
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · see citing works
Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.1.162 · Cited by 639 · see citing works
Public Perceptions About Sex Offenders and Community Protection Policies
Levenson, J. S., Brannon, Y. N., Fortney, T., & Baker, J. (2007) · Analyses of Social Issues and Public Policy · doi:10.1111/j.1530-2415.2007.00119.x · Cited by 556 · see citing works
Newman, D. T., Fast, N. J., & Harmon, D. J. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.03.008 · Cited by 550 · see citing works
The threat of algocracy: reality, resistance and accommodation
Danaher, J. (2016) · Philosophy & Technology · doi:10.1007/s13347-015-0211-1 · Cited by 519 · see citing works
Treatment selection in depression.
Cohen, Z. D., & DeRubeis, R. J. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084746 · Cited by 435 · see citing works
An investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394 · see citing works
Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.008 · Cited by 341 · see citing works
Langer, M., & Landers, R. N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106878 · Cited by 338 · see citing works
Spatial ability and STEM: A sleeping giant for talent identification and development
Lubinski, D. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.03.022 · Cited by 314 · see citing works
Shlonsky, A., & Wagner, D. (2005) · Children and Youth Services Review · doi:10.1016/j.childyouth.2004.11.007 · Cited by 254 · see citing works
Saunders, J., Hunt, P., & Hollywood, J. S. (2016) · Journal of Experimental Criminology · doi:10.1007/s11292-016-9272-0 · Cited by 193 · see citing works
Gambrill, E., & Shlonsky, A. (2000) · Children and Youth Services Review · doi:10.1016/s0190-7409(00)00123-7 · Cited by 187 · see citing works
A coffee can, factor analysis, and prediction of antisocial behavior: The structure of criminal risk
Kroner, D. G., Mills, J. F., & Reddon, J. R. (2005) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2004.01.011 · Cited by 173 · see citing works
Interpretable classification models for recidivism prediction
Zeng, J., Ustun, B., & Rudin, C. (2017) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12227 · Cited by 220 · see citing works
Cuccaro-Alamin, S., Foust, R., Vaithianathan, R., & Putnam-Hornstein, E. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.06.027 · Cited by 145 · see citing works
Oswald, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0359 · Cited by 132 · see citing works
The superiority of simple alternatives to regression for social science predictions
Dana, J., & Dawes, R. M. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029003317 · Cited by 131 · see citing works
Lilienfeld, S. O., Marshall, J., Todd, J. T., & Shane, H. C. (2014) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2014.976332 · Cited by 105 · see citing works
The need for comprehensive risk management systems in child welfare
Gambrill, E., & Shlonsky, A. (2001) · Children and Youth Services Review · doi:10.1016/s0190-7409(00)00124-9 · Cited by 103 · see citing works
Re-visioning risk assessment for human service decision making
Schwalbe, C. (2004) · Children and Youth Services Review · doi:10.1016/j.childyouth.2004.02.011 · Cited by 94 · see citing works
Predicting domestic violence: A meta-analysis on the predictive validity of risk assessment tools
van der Put, C. E., Gubbels, J., & Assink, M. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2019.03.008 · Cited by 83 · see citing works
Illusions in Regression Analysis
Armstrong, J. S. (2011) · doi:10.2139/ssrn.1969740 · Cited by 73 · see citing works
Fairness, accountability and transparency: Notes on algorithmic decision-making in criminal justice
Chiao, V. (2019) · International Journal of Law in Context · doi:10.1017/s1744552319000077 · Cited by 72 · see citing works
Artificial Intelligence and Groups: Effects of Attitudes and Discretion on Collaboration
Bezrukova, K., Griffith, T. L., Spell, C., Rice, V., & Yang, H. E. (2023) · Group & Organization Management · doi:10.1177/10596011231160574 · Cited by 51 · see citing works
(2016) · Psychological Assessment · doi:10.1037/pas0000168.supp · Cited by 2 · see citing works
- Authors
- Grove, W. M., & Meehl, P. E.
- Affiliations
- University of Minnesota (US)
- Venue
- Psychology, Public Policy, and Law
- Published
- 1996-06
- Volume
- 2
- Issue
- 2
- Pages
- 293-323
- ISSN
- 1076-8971 (ISSN-L)
- 1939-1528
- OpenAlex
- W2102256472
- Cited by
- 1,457
- References
- 4
- Citations by year
- 2026: 21 · 2025: 29 · 2024: 38 · 2023: 48 · 2022: 39 · 2021: 59 · 2020: 76 · 2019: 59 · 2018: 35 · 2017: 44 · 2016: 48 · 2015: 39 · 2014: 56 · 2013: 66 · 2012: 60
- FWCI
- 21.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychology Public Policy and Law (publishedVersion)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- clinical judgment, statistical forecasting, prediction accuracy, actuarial methods, parole decision-making, case conferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review