When shall we use our heads instead of the formula?
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
1 online resource (PDF, page 498-506)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In identifiable 'broken-leg' scenarios (Meehl, 1957), the physician needs to be able to override the AI system.”
From The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts (2025) · cites this paper as Meehl, 1957
Citations
Cites
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · cited 1×
“" He adduces indirect evidence for the construct validity (1) of Iiorschach Card VII reactions.”
BackgroundSelf-citationClinical versus statistical prediction: A theoretical analysis and a review of the evidence.
Meehl, P. E. (1954) · University of Minnesota Press eBooks · doi:10.1037/11281-000 · Cited by 2,171
Self-citationAntecedent probability and the efficiency of psychometric signs, patterns, or cutting scores.
Meehl, P. E., & Rosen, A. (1955) · Psychological Bulletin · doi:10.1037/h0048070 · Cited by 1,207
Self-citationMeehl, P. E. (1956) · American Psychologist · doi:10.1037/h0044164 · Cited by 324
Self-citationAnalyzing the clinical process.
McArthur, C. C. (1954) · Journal of Counseling Psychology · doi:10.1037/h0061275 · Cited by 42
Symposium on Clinical and Statistical Prediction: The Tie That Binds.
Meehl, P. E. (1956) · Journal of Counseling Psychology · doi:10.1037/h0039608 · Cited by 22
Self-citation
Cited by
Items 201–300 of 311
The Use of Statistical Heuristics in Everyday Inductive Reasoning
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.030 · Cited by 10
The Ethics of Empathy: Walking a Fine Line in Forensic Evaluations
Mulay, A. L., Mivshek, M. E., Kaufman, H., & Waugh, M. H. (2018) · Journal of Forensic Psychology Research and Practice · doi:10.1080/24732850.2018.1490682 · Cited by 13
“As Paul Meehl (1957) posed, “When should we use our heads instead of the formula?””
BackgroundCASE-BY-CASE VERSUS RULE GENERATED PROCEDURES FOR THE ALLOCATION OF SCARCE RESOURCES
Dawes, R. M. (1977) · Elsevier eBooks · doi:10.1016/b978-0-12-397240-8.50011-2 · Cited by 9
Blinding or information control in diagnosis: could it reduce errors in clinical decision-making?
Lockhart, J. J., & Satya‐Murti, S. (2018) · Diagnosis · doi:10.1515/dx-2018-0030 · Cited by 9
A contextual perspective of clinical judgement in couples and family therapy: is the bridge too far?
Ivey, D. C., Scheel, M., & Jankowski, P. J. (1999) · Journal of Family Therapy · doi:10.1111/1467-6427.00124 · Cited by 8
Support Theory: A Nonextensional Representation of Subjective Probability
Tversky, A., & Koehler, D. J. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.027 · Cited by 8
Personal Decision Counselling: Counsellors Without Clients?
Jungermann, H., & Schütz, H. (1992) · Applied Psychology · doi:10.1111/j.1464-0597.1992.tb00697.x · Cited by 11
Terrorism, dread risk, and bicycle accidents
Ayton, P., Murray, S., & Hampton, J. A. (2009) · PsycEXTRA Dataset · doi:10.1037/e615882011-026 · Cited by 8
“(Meehl, 1957).”
Risk Assessment of Juveniles Adjudicated for Possession of Child Sexual Exploitation Material
Falligant, J. M., Alexander, A. A., & Burkhart, B. R. (2017) · Journal of Forensic Psychology Research and Practice · doi:10.1080/15228932.2017.1270640 · Cited by 7
“These clinical data would constituteMeehl’s version of a broken leg, supporting a designation of high risk in spite of the low actuarial risk associated with CSEM adolescents (Meehl, 1957).”
BackgroundAlgorithms, Creditworthiness, and Lending Decisions
Leal, A. A. (2024) · Data science, machine intelligence, and law · doi:10.1007/978-3-031-47946-5_17 · Cited by 19
Tetlock, P. E. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.034 · Cited by 10
Problem Definition in Marital and Family Therapy: A Qualitative Study
Jankowski, P. J., & Ivey, D. C. (2001) · Contemporary Family Therapy · doi:10.1023/a:1013001012043 · Cited by 7
“Research results have consistently supported the superiority of actuarial judgment over clinical judgment in terms of predictive and diagnostic accuracy (Goldberg, 1968; Goldberg & Werts, 1966; Meehl, 1954, 1957; Sawyer, 1966).”
ResultSources of error and meaning in the pediatric neuropsychological evaluation
Weiler, M. D., Willis, W. G., & Kennedy, M. L. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-802203-0.00007-9 · Cited by 7
The Integration of Clinical and Experimental Work
Covino, N. A. (1997) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207149708416113 · Cited by 7
Gruber, F. A. (1999) · Journal of Speech Language and Hearing Research · doi:10.1044/jslhr.4202.432 · Cited by 7
“Meehl (1958) concluded that, “Both theoretical and empirical considerations suggest that we would be well advised to concentrate effort on improving our actuarial techniques rather than on the calibration of each clinician for each of a large number of different prediction problems” (p. 505).”
BackgroundDernevik, M. (2004) · Figshare · Cited by 9
Psychological Assessment in Correctional Settings
Megargee, E. I. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop210016 · Cited by 9
Counselor confidence in accuracy of predictions.
Watley, D. J. (1966) · Journal of Counseling Psychology · doi:10.1037/h0023065 · Cited by 7
When do people rely on algorithms
Logg, J. M. (2016) · eScholarship (California Digital Library) · Cited by 10
Performance Validity Tests in Neurocognitive/Neuropsychological Assessments
Soble, J. R., Ovsiew, G. P., & Phillips, M. S. (2025) · Springer eBooks · doi:10.1007/978-3-031-69734-0_10 · Cited by 6
Park, H. S., Becker, K. D., & Chorpita, B. F. (2025) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-025-01297-y · Cited by 6
“…such decisions may be more prone to inadvertent missteps as therapists do their best with limited guidance to predict what is the next best strategy (see Meehl, 1957), leaving them with vague boundaries separat-ing appropriate from less appropriate variations of clinical practice (Dawes, 2005).”
The clinician and the statistician
Schoolman, H. M. (1982) · Statistics in Medicine · doi:10.1002/sim.4780010407 · Cited by 6
Do we under utilise actuarial judgement and decision analysis?
Hamilton, J. D. (2001) · Evidence-Based Mental Health · doi:10.1136/ebmh.4.4.102 · Cited by 6
Teaching Counseling Theory: Some Issues and Points of View
Brammer, L. M. (1966) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1966.tb02056.x · Cited by 6
Improving Analysis: Dealing with Information Processing Errors
Rodgers, R. S. (2006) · International Journal of Intelligence and CounterIntelligence · doi:10.1080/08850600600829858 · Cited by 12
The Role of Frequency and Affective Assessment in Associative Enrichment
Rychlak, J. F., & Nguyen, T. D. (1979) · The Journal of General Psychology · doi:10.1080/00221309.1979.9710961 · Cited by 6
Expert Systems for Psychiatric Pharmacotherapy
Stein, D. J., Patterson, R. D., & Hollander, E. (1994) · Psychiatric Annals · doi:10.3928/0048-5713-19940101-12 · Cited by 6
Twigge, L., Theron, C. C., Steel, H. R., & Meiring, D. (2005) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v31i1.178 · Cited by 4
“…a mechanical method of combining information to arrive at an overall inference about the expected criterion performance of an individual that was objectively derived via statistical or mathematical analysis from actual criterion and predictor data sets (Meehl, 1957; Murphy & Davidshofer, 1988).”
MethodDo counselors know when to use their heads instead of the formula?
Watley, D. J. (1968) · Journal of Counseling Psychology · doi:10.1037/h0025341 · Cited by 5
The Application of Method in the Construction of Political Science Theory
Jackson, M. W. (1972) · Canadian Journal of Political Science · doi:10.1017/s0008423900034673 · Cited by 5
Gilovich, T. D., Griffin, D., & Kahneman, D. J. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.001 · Cited by 5
Models of Inference in Evaluating Brain—Behavior Relationships in Children
Fennell, E. B., & Bauer, R. M. (1989) · Critical issues in neuropsychology · doi:10.1007/978-1-4899-6807-4_9 · Cited by 5
Improving Clinical Prediction of Bipolar Spectrum Disorders in Youth
Frazier, T. W., Youngstrom, E. A., Fristad, M. A., Demeter, C., Birmaher, B. B., Kowatch, R. A., Arnold, L. E., Axelson, D., Gill, M. K., Horwitz, S. M., et al. (2014) · Journal of Clinical Medicine · doi:10.3390/jcm3010218 · Cited by 4
Dunn, J. C. (2016) · Digital Archive @ GSU · doi:10.57709/8570509 · Cited by 4
How Alike Is It? versus How Likely Is It?: A Disjunction Fallacy in Probability Judgments
Bar‐Hillel, M., & Neter, E. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.005 · Cited by 10
Selection of College Scholarship Students: Statistical vs. Clinical Methods
Rosen, N. A., & HORN, J. W. V. (1961) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1961.tb02417.x · Cited by 4
Counseling Research: Irrelevant or Ignored?
Lichtenberg, J. W. (1986) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1986.tb01135.x · Cited by 6
Via clinical to statistical prediction
Groot, A. D. D. (1961) · Acta Psychologica · doi:10.1016/0001-6918(61)90017-8 · Cited by 4
A Review of Studies on Expert Estimation of Software Development Effort
Jørgensen, M. (2006) · Springer eBooks · doi:10.1007/978-3-540-32179-8_15 · Cited by 5
Klinische und statistische Vorhersagen in der psychologischen Diagnostik
Westmeyer, H. (1979) · Berichte zur Wissenschaftsgeschichte · doi:10.1002/bewi.19790020111 · Cited by 3
Paul Everett Meehl: The cumulative record
Waller, N. G., & Lilienfeld, S. O. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20177 · Cited by 4
“…in his career, after reading literally hundreds of books on Christian and Eastern theology, Meehl authored several articles and a highly regarded book on the influence of religion on psychological health (e.g., Meehl, 1957a, 1965; Meehl, Klann, Schmieding, Breimeier, & SchroederSlomann, 1958).”
BackgroundConfidence in Personality Assessment
Schinka, J. A. (1976) · Psychological Reports · doi:10.2466/pr0.1976.38.1.62 · Cited by 3
Healthcare assistants’ experiences on forensic mental health wards
Boardman, S., Clarbour, J., & Rayner, K. (2018) · Journal of Forensic Practice · doi:10.1108/jfp-07-2017-0028 · Cited by 3
Richters, J. E., Waters, E., & Vaughn, B. E. (1988) · Child Development · doi:10.1111/j.1467-8624.1988.tb01485.x · Cited by 3
Towards Data-Leveraged Behavioral Policy Design for Alleviating Peak Electricity Demand
Pat, A. (2016) · UWSpace (University of Waterloo) · Cited by 3
Practical Methods for Assessing the Quality of Subjective Selection ProcessesPreprint
Kornish, L. J., & Ulrich, K. T. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2499049 · Cited by 4
“There is a long stream of literature documenting the superior performance of “mechanical” (algorithmic or formulaic) over “clinical” (subjective or holistic) decisions (Meehl 1957, Dawes, Faust, and Meehl 1989; Grove and Meehl 1996).”
BackgroundAppraisal and Counseling: Are They Compatible?
Riper, B. W. V. (1982) · Measurement and Evaluation in Guidance · doi:10.1080/00256307.1982.12022287 · Cited by 3
Weiner, I. B. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop210001 · Cited by 3
(2016) · Psychological Assessment · doi:10.1037/pas0000168.supp · Cited by 2
Unpacking, Repacking, and Anchoring: Advances in Support Theory
Rottenstreich, Y., & Tversky, A. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.028 · Cited by 3
Fujita, G. Y., & O'Reilly, J. P. (1970) · Journal for Research in Mathematics Education · doi:10.2307/748593 · Cited by 2
Clinical Confidence and Self-Monitoring Behavior
Abston, N. (1980) · Perceptual and Motor Skills · doi:10.2466/pms.1980.51.3.1021 · Cited by 2
Epistemology for (Real) People
Bishop, M. A., & Trout, J. D. (2016) · Wiley eBooks · doi:10.1002/9781118869109.ch8 · Cited by 3
The Psychology of Big Data: Developing a 'Theory of Machine' to Examine Perceptions of AlgorithmsPreprint
Logg, J. M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3878873 · Cited by 2
Validation of a selection battery used by the South African Military Academy
Pretorius, M., & Redelinghuys, M. (2010) · SUNScholar (Stellenbosch University) · Cited by 4
Just because it’s dark doesn’t mean that we can’t go there
Harms, P. D., Wood, D., & DeSimone, J. A. (2019) · Industrial and Organizational Psychology · doi:10.1017/iop.2019.40 · Cited by 1
“While FFM traits are typically assessed using self-report measures, clinical diagnoses are often made on the basis of clinical judgment in conjunction with self-reported symptomology (First, Gibbon, Spitzer, Williams, & Benjamin, 1997; Meehl, 1957).”
Lawson, A. K., Fitzgerald, L. F., & Collinsworth, L. L. (2022) · Psychological Injury and Law · doi:10.1007/s12207-022-09465-x · Cited by 1
“But if the family doctor announced that Professor X had just broken his leg, no sensible (psychologist) would stick with the equation” (Meehl, 1957, p. 501), thus acknowledging that the reliability and validity of even the most scientifically developed actuarial prediction are vulnerable to the…”
BackgroundHoltzman, G. S., Yang, Y., Louis, P., West, S. G., & Kandaswamy, P. (2024) · Scientific Reports · doi:10.1038/s41598-024-73116-1 · Cited by 3
Examining the Relationship Between Therapist Perception of Client Progress and Treatment Outcomes
Waltman, S. H. (2010) · CommonKnowledge Research Repository (Pacific University Oregon) · Cited by 1
Ariyo, A., & Abegunde, E. K. (1992) · Managerial Finance · doi:10.1108/eb013695 · Cited by 1
Gilovich, T. D., Griffin, D., & Kahneman, D. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.045 · Cited by 1
Response : Scientific Integrity
Davis, B. D. (1990) · Science · doi:10.1126/science.247.4939.145 · Cited by 1
On dispensing with the selection interview
Tucker, J. D. (1970) · Australian Psychologist · doi:10.1080/00050067008259881 · Cited by 1
An examination of decision aid reliance in a dynamic environment
Briggs, J. W. (2003) · VTechWorks (Virginia Tech) · Cited by 1
When Less Is More: Counterfactual Thinking and Satisfaction among Olympic Medalists
Medvec, V. H., Madey, S. F., & Gilovich, T. D. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.037 · Cited by 1
Muheizen, J. L. (2013) · eScholarship (California Digital Library) · Cited by 2
THE PERSONALITY ASSESSMENT PROCESS
Greene, R. L., & Weiner, I. B. (2017) · Wiley eBooks · doi:10.1002/9781119311263.ch2 · Cited by 1
ETHICAL CONSIDERATIONS IN PERSONALITY ASSESSMENT
Greene, R. L., & Weiner, I. B. (2017) · Wiley eBooks · doi:10.1002/9781119311263.ch4 · Cited by 2
The Effect of working memory and math ability on decision making
Krause, J. A. (2011) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/2292621
Silverstein, M. L. (1993) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6001_8
A graphic description of counseling relationships.
Drasgow, J. (1960) · Journal of Counseling Psychology · doi:10.1037/h0041614
Counselor Confidence and Accuracy of Prognoses of Success or Failure
Watley, D. J. (1966) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1966.tb03095.x
Cognitive Structure and Clinical Inference
Hammond, L. K. (1970) · The Journal of General Psychology · doi:10.1080/00221309.1970.9710791
SOME MISSING LINKS: IN COUNSELING THEORY AND RESEARCH
Schwebel, M. (1962) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1962.tb02292.x
Some epistemological and methodological issues in clinical research
Wolman, B. B. (1966) · Inquiry · doi:10.1080/00201746608601457
Improving the Use Case Point and COCOMO with Expert Judgment and Analogy based Estimation
Nagar, C., & Dixit, A. (2013) · International Journal of Computer Applications
Gender-Responsive Risk Assessment: A Comparison of Women and Men
Bell, V. (2012) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 3
Payne, P. A. (1970) · Measurement and Evaluation in Guidance · doi:10.1080/00256307.1970.12022433
Strategic Reliabilism: Robust Reliability
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0005
The Troubles with Standard Analytic Epistemology
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0008
Putting Epistemology into Practice: Positive Advice
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0010
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0002
Putting Epistemology into Practice: Normative Disputes in Psychology
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0009
The Amazing Success of Statistical Prediction Rules
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0003
Strategic Reliabilism: The Costs and Benefits of Excellent Judgment
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0006
Extracting Epistemic Lessons from Ameliorative Psychology
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0004
Strategic Reliabilism: Epistemic Significance
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0007
Dangerous predictions: evaluation methods for and consequences of predicting dangerous behavior
Bokhari, E. (2014) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Kontroversen "skjønn versus formler"
Torp, J. A. (2007)
Thinking Clearly about Psychology V1: Matters of Public Interest
Grove, & Cicchetti (1991) · Project Muse (Johns Hopkins University)
The Thick of It: Freely Wandering in Academic Medicine
Duberstein, P. R. (2017) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.12.001
Time Prediction Methods and Principles
Halkjelsvik, T., & Jørgensen, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-74953-2_7
MINNESOTA MULTIPHASIC PERSONALITY INVENTORY‐ADOLESCENT
Greene, R. L., & Weiner, I. B. (2017) · doi:10.1002/9781119311263.ch7
(1994) · Elsevier eBooks · doi:10.1016/b978-0-12-488440-3.50014-5
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0001
Bishop, M. A., & Trout, J. D. (2005) · Oxford University Press eBooks · doi:10.1093/0195162293.003.0011
(2005) · Oxford University Press eBooks · doi:10.1093/0195162293.001.0001.002.004
Appendix: Objections and Replies
(2005) · Oxford University Press eBooks · doi:10.1093/0195162293.005.0001
Metadata
- Authors
- Meehl, P. E.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Meehl, Paul E.
- Venue
- Journal of Counseling Psychology
- Published
- 1957
- Volume
- 4
- Issue
- 4
- Pages
- 268-273
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2060895483
- Cited by
- 310
- References
- 6
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 6 · 2023: 6 · 2022: 4 · 2021: 1 · 2020: 8 · 2019: 6 · 2018: 9 · 2017: 10 · 2016: 4 · 2015: 3 · 2014: 4 · 2013: 8 · 2012: 6
- FWCI
- 9.10
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Journal of Counseling Psychology (publishedVersion)
- University of Minnesota Digital Conservancy (University of Minnesota) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Social Sciences › Psychology › Applied Psychology › Problem Solving Skills Development
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- clinical decision-making, clinical judgment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.