Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Items 601–700 of 1,001
Maiers, W. (2021) · Review of General Psychology · doi:10.1177/10892680211033915 · Cited by 7
Saldanha, J. P., & DeAngelo, G. J. (2022) · The International Journal of Logistics Management · doi:10.1108/ijlm-07-2021-0367 · Cited by 7
Priestley, D. R., Staph, J., Koneru, S., Rajtmajer, S. M., Cwiek, A. P., Vervoordt, S. M., & Hillary, F. G. (2022) · Brain Communications · doi:10.1093/braincomms/fcac322 · Cited by 7
Clinical and statistical prediction after 50 years: a dedication to Paul Meehl
Morera, O. F., & Dawes, R. M. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.538 · Cited by 7
Bayesian Approaches to Assessing the Parallel Lines Assumption in Cumulative Ordered Logit Models
Xu, J., Bauldry, S., & Fullerton, A. S. (2019) · Sociological Methods & Research · doi:10.1177/0049124119882461 · Cited by 7
Inferência Baseada em Magnitudes na investigação em Ciências do Esporte
Marcelino, R., Pasquarelli, B. N., & Sampaio, J. E. (2019) · Revista Brasileira de Educação Física e Esporte · doi:10.11606/1807-5509201900040667 · Cited by 7
Multiple hypotheses testing of fish incidence patterns in an urbanized ecosystem
Chizinski, C. J., Higgins, C. L., Shavlik, C. E., & Pope, K. L. (2005) · Aquatic Ecology · doi:10.1007/s10452-005-9025-z · Cited by 7
Fossati, A., & Lenzenweger, M. F. (2009) · Archivio Istituzionale della Ricerca - Università Vita-Salute San Raffaele · Cited by 7
Hypothesis testing in generative grammar: Evaluation of predicted schematic asymmetries
Hoji, H. (2010) · Journal of Japanese Linguistics · doi:10.1515/jjl-2010-0104 · Cited by 7
Gatobu, S., Arocha, J. F., & Hoffman‐Goetz, L. (2016) · Basic and Applied Social Psychology · doi:10.1080/01973533.2016.1197129 · Cited by 7
Why It Is Problematic to Calculate Probabilities of Findings Given Range Null Hypotheses
Trafimow, D. (2017) · Open Journal of Statistics · doi:10.4236/ojs.2017.73034 · Cited by 7
Understanding salt-tolerance and biota–stressor interactions in freshwater invertebrate communities
Kefford, B. J., Bray, J. P., Nichols, S. J., Reich, J., Nally, R. M., O’Reilly‐Nugent, A., King, G. K. K., & Thompson, R. M. (2021) · Marine and Freshwater Research · doi:10.1071/mf21164 · Cited by 7
Structural Analysis of Social Behavior and Perceptions of Caregiving
France, A.-C. I., & Alpher, V. S. (1995) · The Journal of Psychology · doi:10.1080/00223980.1995.9914975 · Cited by 7
Are Effect Sizes and Confidence Levels Problems For or Solutions To the Null Hypothesis Test?
Riopelle, A. J. (2000) · The Journal of General Psychology · doi:10.1080/00221300009598579 · Cited by 7
Mieg, H. A. (1994) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-322-99839-2 · Cited by 7
Zur Kritik der empiristischen Forschungspraxis / Criticism of Empirist Research Practice
Münch, R. (1972) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-1972-0403 · Cited by 7
«Grados de libertad» y el estudio de casos
Campbell, D. T. (1982) · Studies in Psychology Estudios de Psicología · doi:10.1080/02109395.1982.10821319 · Cited by 7
Wolff, W. M. (1970) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0029018 · Cited by 7
Serlin, R. C., & Lapsley, D. K. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_13 · Cited by 7
Woods, B. D. (2011) · UC Research Repository (University of Canterbury) · doi:10.26021/7279 · Cited by 7
Körber, M. (2018) · mediaTUM (Technical University of Munich) · doi:10.13140/rg.2.2.24047.97445 · Cited by 7
Understanding rumination as a form of inner speech: probing the role of motor processesPreprint
Nalborczyk, L. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/p6dct · Cited by 7
Basic statistical considerations for physiology: The journal Temperature toolboxPreprint
Caldwell, A. R., & Cheuvront, S. N. (2020) · SportRxiv (OSF Preprints) · doi:10.31236/osf.io/rt4bp · Cited by 7
Better Inference in Neuroscience: Test Less, Estimate More
Calin-Jageman, R. J. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1133-22.2022 · Cited by 7
Social especially agonistic behaviour in the pigeon
Spiteri, N. J. (1975) · Durham e-Theses (Durham University) · Cited by 7
Sotola, L. K., & Credé, M. (2023) · Journal of Research in Personality · doi:10.1016/j.jrp.2023.104435 · Cited by 6
Alternative to the statistical mass confusion of testing for “no effect”
Morgan, J. (2025) · The Journal of Cell Biology · doi:10.1083/jcb.202403034 · Cited by 6
Deterding, S., Guckelsberger, C., Lintunen, E. M., & Ady, N. M. (2025) · Motivation and Emotion · doi:10.1007/s11031-025-10156-8 · Cited by 6
Jones, A. L., Kordsmeyer, T. L., Kramer, R. S. S., Stern, J., & Penke, L. (2025) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2025.106781 · Cited by 6
Against theory-motivated experimentation: Can random experimental choice lead to better theories?
Dubova, M., Moskvichev, A., & Zollman, K. (2026) · Collective Intelligence · doi:10.1177/26339137261421577 · Cited by 6
The Integration of Explanation and Prediction in Behavioral Science
Almaatouq, A., & Na, R. W. (2026) · Current Directions in Psychological Science · doi:10.1177/09637214261419427 · Cited by 6
Riesthuis, P., Rassin, E., Bücken, C. A., Booker, A., Chin, J. M., Goldfarb, D., Deferme, D., & Otgaar, H. (2025) · The International Journal of Evidence & Proof · doi:10.1177/13657127251357630 · Cited by 6
Second-order facial features are processed analytically in composite faces
Cheng, X. J., & Little, D. R. (2025) · Attention Perception & Psychophysics · doi:10.3758/s13414-025-03144-0 · Cited by 6
Research as Artisanship versus Research as Generation of Novelty: The March to Nowhere
Cropley, A. J. (2018) · Creativity Research Journal · doi:10.1080/10400419.2018.1500190 · Cited by 6
Motion and Meaning: Sample-Level Nonlinear Analyses of Virtual Reality Tracking Data
Miller, M. R., Jun, H., & Bailenson, J. N. (2021) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct54149.2021.00039 · Cited by 6
The Significance Test Controversy Revisited
Lecoutre, B., & Poitevineau, J. (2022) · Springer eBooks · doi:10.1007/978-3-662-65705-8_5 · Cited by 6
Is Social Work Research in Crisis?
Dunleavy, D. J., & Lacasse, J. R. (2023) · Research on Social Work Practice · doi:10.1177/10497315231188684 · Cited by 7
Fisher, W. P. (2024) · International journal of advances in production research. · doi:10.62743/uad.6179 · Cited by 6
Parameter Estimation vs. Hypothesis Testing
Woodson, M. I. C. E. (1969) · Philosophy of Science · doi:10.1086/288247 · Cited by 6
Significance Testing in Neuroimagery
Machery, É. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137286734_13 · Cited by 6
Li, J. (2010) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 6
Green, C. D., Abbas, S., Belliveau, A. R., Beribisky, N., Davidson, I. J., DiGiovanni, J., Heidari, C., Martin, S. M., Oosenbrug, E., & Wainewright, L. (2018) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000139 · Cited by 6
The power of directional predictions in psychology
Trafimow, D. (2022) · Journal for the Theory of Social Behaviour · doi:10.1111/jtsb.12343 · Cited by 6
In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
Wampold, B. E., Flückiger, C., Re, A. C. D., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., et al. (2019) · PERSON · doi:10.24989/person.v23i1.2428 · Cited by 6
Aspects de quelques critiques non fondées de la théorie des tests statistiques
Zaki, M., & M’Hamedi, Z. E. (2013) · Annales de didactique et de sciences cognitives · doi:10.4000/12dwz · Cited by 6
Nudging aside Meehl's paradox.
Leventhal, L. (1994) · Canadian Psychology/Psychologie canadienne · doi:10.1037/0708-5591.35.3.283 · Cited by 6
Reproducibility in Clinical Psychology
Hopwood, C. J., & Vazire, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.035 · Cited by 6
ANSWERING TWO CRITICISMS OF HYPOTHESIS TESTING
Leventhal, L. (1999) · Psychological Reports · doi:10.2466/pr0.1999.85.1.3 · Cited by 6
The Application of Psychological Theory in Educational Settings: An Overview
Cellura, A. R. (1969) · American Educational Research Journal · doi:10.2307/1161857 · Cited by 6
Aspects of psychology and epistemology
Blunt, P. (1980) · Australian Psychologist · doi:10.1080/00050068008254370 · Cited by 6
Methodocentricity, Theoretical Sterility, and The Socio-Behavioural Sciences
Shames, M. L. (1987) · Advances in psychology · doi:10.1016/s0166-4115(08)60078-3 · Cited by 6
A conjoing measurement analysis of clinical predictions
Garb, H. N. (1983) · Journal of Clinical Psychology · doi:10.1002/1097-4679(198303)39:2<295::aid-jclp2270390229>3.0.co;2-0 · Cited by 6
Significance Test in Studies of Nonrandomly Assigned Subjects: A Call for More Discussion
Tachibana, T. (1988) · Psychological Reports · doi:10.2466/pr0.1988.62.2.415 · Cited by 6
Kirk, R. E. (2005) · Wiley eBooks · doi:10.1002/0470013192.bsa188 · Cited by 6
Why moral judgements change across variations of trolley‐like problems
Cohen, D. J., & Quinlan, P. T. (2025) · British Journal of Psychology · doi:10.1111/bjop.12782 · Cited by 5
Mihalits, D. S. (2025) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-025-09931-6 · Cited by 5
Schäfer, T. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06436-w · Cited by 5
How to Identify and How to Conduct Research that Is Informative and Reproducible
Zickfeld, J., & Schubert, T. W. (2019) · Theory and history in the human and social sciences · doi:10.1007/978-3-030-33099-6_9 · Cited by 5
Marcoulides, K. M., & Yuan, K. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01796-4 · Cited by 5
Warning Signs for Hype in School-Based Assessment: Implications for Training and Pedagogy
Farmer, R. L., McGill, R. J., Lockwood, A. B., Dombrowski, S. C., Canivez, G. L., & Zaheer, I. (2022) · School Psychology Training and Pedagogy · doi:10.67337/sptp.v39i1.56 · Cited by 5
Two Questions to Foster Critical Thinking in the Field of Psychology
Holtz, P. (2020) · Meta-Psychology · doi:10.15626/mp.2018.984 · Cited by 5
Psychology of Science and History of Psychology: Putting Behavioral Generalizations to the Test
Feist, G. J. (1995) · Psychological Inquiry · doi:10.1207/s15327965pli0602_4 · Cited by 5
Zhang, G., & Algina, J. J. (2008) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1209614700 · Cited by 5
Hess, M. R. (2003) · Digital Commons - University of South Florida (University of South Florida) · Cited by 5
Popper, Meehl, and Progress: The Evolving Concept of Risky Test in the Science of Psychopathology
Zachar, P. (2015) · Psychological Inquiry · doi:10.1080/1047840x.2015.1037819 · Cited by 5
Subjective, individual and aggregate references in educational research
Moxley, R. A. (1979) · Instructional Science · doi:10.1007/bf00117009 · Cited by 5
The Problem of Achieving Scientific Cognitive-Behavior Therapy
Ellis, A. (1978) · The Counseling Psychologist · doi:10.1177/001100007800700303 · Cited by 5
Take off those blinkers, mate! Response to Bourke, Clements and Rowley
Menon, R. (1993) · Mathematics Education Research Journal · doi:10.1007/bf03217252 · Cited by 5
Statistical Analysis: Theory Versus Practice
Winkler, R. L. (1974) · Springer eBooks · doi:10.1007/978-94-010-2288-0_7 · Cited by 5
Methodology and Statistics in the Behavioral Sciences The Old and the New
Townsend, J. T. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00279.x · Cited by 5
The Need for Theory Development in Psychology. Some Case Studies
Retief, A. (1986) · South African Journal of Psychology · doi:10.1177/008124638601600301 · Cited by 5
Warren, N. A. (1980) · doi:10.1007/978-1-349-16331-1_10 · Cited by 5
Some Basic Perceptual Processes in Reading.
Pick, A. D. (1970) · Young children · Cited by 5
Kerschke, D. (2025) · Methods in Psychology · doi:10.1016/j.metip.2025.100186 · Cited by 4
Elegant theories and the problems of social psychology
Syed, M. (2025) · European Review of Social Psychology · doi:10.1080/10463283.2025.2494434 · Cited by 4
Money in the bank: progressive problem shifts in criminological science
Brauer, J. R., & Day, J. C. (2025) · Theory and Society · doi:10.1007/s11186-025-09645-z · Cited by 4
Untested Assumptions and Tenuous Evidence: A Critique of the Dual-Process Account of Moral Judgment
Quinlan, P. T., & Cohen, D. J. (2025) · Behavioral Sciences · doi:10.3390/bs16010020 · Cited by 4
Contrast Variable for Group Comparisons in Biopharmaceutical Research
Zhang, X. D., & Heyse, J. F. (2012) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2011.646905 · Cited by 4
Strong-Form Frequentist Testing In Communication Science: Principles, Opportunities, And Challenges
Coenen, L., & Smits, T. (2022) · Communication Methods and Measures · doi:10.1080/19312458.2022.2086690 · Cited by 4
Prognosticating Offending in Early Adulthood: How Early Can We Predict?
Loughran, T. A., Augustyn, M. B., Matsuda, M., & Henry, K. L. (2022) · Journal of Quantitative Criminology · doi:10.1007/s10940-022-09561-w · Cited by 4
Cognitive Metascience: A New Approach to the Study of Theories
Miłkowski, M. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9682 · Cited by 4
Three-Sided Testing to Establish Practical Significance: A Tutorial
Isager, P. M., & Fitzgerald, J. D. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251412435 · Cited by 4
It has not been proven why or that most research findings are false
Ashton, J. C. (2018) · Medical Hypotheses · doi:10.1016/j.mehy.2018.02.004 · Cited by 4
Mitä toistettavuuskriisistä pitäisi ajatella? Johdanto tutkijoiden haastatteluihin
Valtonen, J., & Hankonen, N. E. (2025) · Psykologia · doi:10.62443/psykologia.v54i6.91069 · Cited by 4
Model evaluation in human factors and ergonomics (HFE) sciences; case of trust in automation
Poornikoo, M., & Øvergård, K. I. (2023) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2023.2233591 · Cited by 4
6 Measurement logic, aesthetics, and ethics across the sciences: extending the SI units
Jr. Fisher William, P. (2024) · De Gruyter eBooks · doi:10.1515/9783111036496-006 · Cited by 4
Bologna, E. (2011) · Revista Evaluar · doi:10.35670/1667-4545.v11.n1.2842 · Cited by 4
Paul Everett Meehl: The cumulative record
Waller, N. G., & Lilienfeld, S. O. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20177 · Cited by 4
Building Generalizable Case-Based Theory in Human Resources Management
Ang, H. B., & Woodside, A. G. (2018) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1069-096420180000025007 · Cited by 4
Prichard, E. C. (2018) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2018.1481865 · Cited by 4
Lenzenweger, M. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.012 · Cited by 4
Critical Differences in Bayesian and Non‐Bayesian Inference and why the Former is Better
Gill, J. (2010) · Wiley eBooks · doi:10.1002/9780470583333.ch5 · Cited by 4
Huelsman, T. J., Gagnon, S. G., Kidder‐Ashley, P., & Griggs, M. S. (2013) · Early Education and Development · doi:10.1080/10409289.2013.770636 · Cited by 4
Weak Models, Nil Hypotheses, And Decorative Statistics: Is There Really No Hope?
O’Neill, B. (1995) · Journal of Conflict Resolution · doi:10.1177/0022002795039004007 · Cited by 4
Concepts of evidence in systems analysis: Testing macro-system theories
Teune, H. (1981) · Quality & Quantity · doi:10.1007/bf00144301 · Cited by 4
HYPOTHESIS TESTING IN PSYCHOLOGY: THROWING THE BABY OUT WITH THE BATHWATER?
Granaas, M. M. (2002) · Cited by 4
The Art of Statistics: A Survey of Modern Techniques
Wright, D. B. (2015) · Routledge eBooks · doi:10.4324/9780203874790.ch38 · Cited by 4
If we accept that poor replication rates are mainstream
Alexander, D. M., & Moors, P. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000572 · Cited by 4
Screen size effects in online data collections
Söderlund, M., Colliander, J., & Szugalski, S. (2019) · Journal of Consumer Marketing · doi:10.1108/jcm-10-2018-2882 · Cited by 4
A Robust Root Mean Square Standardized Effect Size in One-Way Fixed-Effects ANOVA
Zhang, G., & Algina, J. J. (2011) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1304222880 · Cited by 4
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.