Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Items 501–600 of 1,001
The meaning and suitability of various effect sizes for structured rater × ratee designs.
Hönekopp, J., Becker, B. J., & Oswald, F. L. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.1.72 · Cited by 15
The earth is round (so we can probably get there from here).
Svyantek, D. J., & Ekeberg, S. E. (1995) · American Psychologist · doi:10.1037//0003-066x.50.12.1101.a · Cited by 15
Teens, screens and well-being: an improved approach
Orben, A. C. (2019) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-xvn1eagpz · Cited by 15
Falsifiability Is Not OptionalPreprint
LeBel, E. P., Berger, D. M., Campbell, L., & Loving, T. J. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/dv94b · Cited by 15
Masur, P. K., & Ranzini, G. (2025) · Journal of Communication · doi:10.1093/joc/jqaf007 · Cited by 14
Normand, M. P. (2017) · Perspectives on Behavior Science · doi:10.1007/s40614-017-0123-8 · Cited by 14
Testing Theories with Bayes Factors
Dienes, Z. P. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009010054.024 · Cited by 14
Strategic thinking in the shadow of self‐enhancement: Benefits and costs
Grüning, D. J., & Krueger, J. I. (2024) · British Journal of Social Psychology · doi:10.1111/bjso.12747 · Cited by 14
Do we really need confidence intervals in the new statistics?
Gorard, S. A. C. (2018) · International Journal of Social Research Methodology · doi:10.1080/13645579.2018.1525064 · Cited by 14
Stop blaming external factors: A historical-sociological argument
Schneider, J. W., Horbach, S. P. J. M., & Aagaard, K. (2021) · Social Science Information · doi:10.1177/05390184211018123 · Cited by 14
From Construct Validity to Theory Validation
Haig, B. D. (2012) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2012.681975 · Cited by 14
Reproducibility, Diversity, and the Crisis of Inference in PsychologyPreprint
Syed, M. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/89buj · Cited by 14
Masharipov, R. S., Knyazeva, I., Nikolaev, Y., Korotkov, A. D., Didur, M., Cherednichenko, D. V., & Kireev, M. V. (2021) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2021.738342 · Cited by 13
Theoretical false positive psychology
Wilson, B. M., Harris, C. R., & Wixted, J. T. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02098-w · Cited by 13
There are no shortcuts to theory
Devezer, B. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23002169 · Cited by 13
LeMire, S. D. (2010) · Journal of Statistics Education · doi:10.1080/10691898.2010.11889492 · Cited by 13
An Interactionist Approach to Cognitive Debiasing
Bland, S. (2020) · Episteme · doi:10.1017/epi.2020.9 · Cited by 13
Construct Validation and Clinical Assessment
Haig, B. D. (1999) · Behaviour Change · doi:10.1375/bech.16.1.64 · Cited by 13
The Standardized Mean Difference within the Framework of Item Response Theory
Wang, W., & Chen, H. C. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164403261049 · Cited by 13
Blunt, P., Richards, D., & Wilson, J. (1989) · Journal of International Development · doi:10.1002/jid.3380010402 · Cited by 13
Positive psychology and romantic scientism: Reply to comments on Brown, Sokal, & Friedman (2013)
Brown, N. J. L., Sokal, A. D., & Friedman, H. L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5172 · Cited by 13
Single paper meta‐analysis is unavoidable
McShane, B. B., & Böckenholt, U. (2025) · Journal of Consumer Psychology · doi:10.1002/jcpy.1462 · Cited by 12
On the use of receiver operating characteristic area under the curve in eyewitness memory research
Riesthuis, P., & Otgaar, H. (2024) · Legal and Criminological Psychology · doi:10.1111/lcrp.12300 · Cited by 12
Sturman, M. C. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199732579.013.0033 · Cited by 12
Böschen, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-98782-3 · Cited by 12
The Meehilan Corroboration-Verisimilitude Theory of Science
Campbell, D. T. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_2 · Cited by 12
Heimann, H. L. (1979) · Springer eBooks · doi:10.1007/978-3-642-66927-9_1 · Cited by 12
Metanauka poznawcza: nowe podejście do badania teorii
Miłkowski, M. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9459 · Cited by 11
Replies to commentaries on beyond playing 20 questions with nature
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J. A., & Watts, D. J. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23002789 · Cited by 11
Relationship between social anxiety and perceived trustworthiness
Cooper, R., Doehrmann, O., Fang, A., Gerlach, A. L., Hoijtink, H., & Hofmann, S. G. (2013) · Anxiety Stress & Coping · doi:10.1080/10615806.2013.834049 · Cited by 11
The Elusive Science of Leadership
Rumsey, M. G. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195398793.013.0027 · Cited by 11
Kavanagh, C. M., & Kapitány, R. (2020) · Journal for the Cognitive Science of Religion · doi:10.1558/jcsr.38713 · Cited by 11
Should we be using significance tests in forecasting research?
Goodwin, P. B. (2007) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2007.01.008 · Cited by 11
NHST is still logically flawed
Schneider, J. W. (2018) · Scientometrics · doi:10.1007/s11192-018-2655-4 · Cited by 11
Crosby, R. D., Wonderlich, S. A., Mitchell, J. E., de Zwaan, M., Engel, S. G., Connolly, K. M., Flessner, C., Redlin, J., Markland, M., Simonich, H. K., et al. (2005) · International Journal of Eating Disorders · doi:10.1002/eat.20194 · Cited by 11
DeLucia, P. R. (1993) · Perception & Psychophysics · doi:10.3758/bf03205198 · Cited by 11
On The Alleged Falsity of the Null Hypothesis
Oakes, W. F. (1975) · The Psychological Record · doi:10.1007/bf03394312 · Cited by 11
Issues in Statistical InferencePreprint
Chow, S. L. (2002) · CogPrints (University of Southampton) · Cited by 11
The Relative Importance of Low Significance Level and High Power in Multiple Tests of Significance
Westermann, R., & Hager, W. (1983) · Perceptual and Motor Skills · doi:10.2466/pms.1983.56.2.407 · Cited by 11
On Severe Tests of Trend Hypotheses in Psychology
Westermann, R., & Hager, W. (1983) · The Psychological Record · doi:10.1007/bf03394838 · Cited by 11
Santos, R. G. (2005) · Mspace (University of Manitoba) · Cited by 11
Computer Simulation, Cognition, and Development: An Introduction
Rabinowitz, F. M., Grant, M. J., & Dingley, H. L. (1987) · Springer series in cognitive development · doi:10.1007/978-1-4612-4694-7_8 · Cited by 11
Dunleavy, D. J. (2020) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/f2c7b_v1 · Cited by 11
Sun, Y., Shen, L., Pan, Z., & Qian, S. (2025) · Communication Research · doi:10.1177/00936502241308599 · Cited by 10
Fisher, W. P., Jr., & Massengill, P. J. (2022) · Springer eBooks · doi:10.1007/978-981-19-3747-7 · Cited by 10
Götz, M., & O’Boyle, E. H. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0742-730120230000041004 · Cited by 10
The Theory Crisis in Criminology: Causes, Consequences, and Solutions
Ducate, C. S., Bostrom, S. R., Proctor, K. R., & Niemeyer, R. E. (2024) · Theoretical Criminology · doi:10.1177/13624806251372169 · Cited by 11
Robustness and Integrative Survival in Significance Testing: The World's Contribution to Rationality
Trout, J. D. (1993) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/44.1.1 · Cited by 10
Challenges Facing Evidence-Based Prevention: Incorporating an Abductive Theory of Method
Mason, W. A., Cogua, J., Fleming, C. B., & Scheier, L. M. (2018) · Evaluation & the Health Professions · doi:10.1177/0163278718772879 · Cited by 10
McKay, D., & O’Donohue, W. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.07.004 · Cited by 10
Social psychology: A field in search of a center
Krueger, J. I., & Funder, D. C. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04570085 · Cited by 10
Five Models of Science, Illustrating How Selection Shapes Methods
Smaldino, P. E. (2022) · University of Pittsburgh Press eBooks · doi:10.2307/j.ctv31djr2f.5 · Cited by 10
Tableplot: A New Tool for Assessing Precise Predictions
Kwan, E., Lu, I. R. R., & Friendly, M. L. (2009) · Zeitschrift für Psychologie · doi:10.1027/0044-3409.217.1.38 · Cited by 10
How to state general qualitative facts in psychology?
Vautier, S. (2011) · Quality & Quantity · doi:10.1007/s11135-011-9502-5 · Cited by 10
The use of Thompson sampling to increase estimation precision
Kaptein, M. C. (2014) · Behavior Research Methods · doi:10.3758/s13428-014-0480-0 · Cited by 10
Steekproefgroottes in plaaslik gepubliseerde psigologiese navorsing
Huysamen, G. K. (1991) · South African Journal of Psychology · doi:10.1177/008124639102100308 · Cited by 10
Critical Rationalism and its Failure to Withstand Critical Scrutiny
Mayo, D. G. (2006) · Springer eBooks · doi:10.1007/1-4020-4207-8_5 · Cited by 10
The converse inequality argument against tests of statistical significance.
Markus, K. A. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.147 · Cited by 10
Mathematical and Computational Modeling of Suicide as a Complex Dynamical SystemPreprint
Wang, S. B., Robinaugh, D. J., Millner, A. J., Fortgang, R. G., Hamm, S., Barrow, C., & Nock, M. K. (2026) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b29cs_v2 · Cited by 10
Changes in methodological study characteristics in psychology between 2010-2021
Böschen, I. (2023) · PLoS ONE · doi:10.1371/journal.pone.0283353 · Cited by 9
Lindsay, R. M. (2025) · Advances in management accounting · doi:10.1108/s1474-787120250000037001 · Cited by 9
Riesthuis, P., & Cribbie, R. A. (2025) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.21.2.p082 · Cited by 9
The Significance Test Controversy Revisited
Lecoutre, B., & Poitevineau, J. (2014) · SpringerBriefs in statistics · doi:10.1007/978-3-662-44046-9_5 · Cited by 9
Chattoe‐Brown, E. (2020) · International Journal of Social Research Methodology · doi:10.1080/13645579.2020.1801602 · Cited by 9
That's Not a Two-Sided Test! It's Two One-Sided Tests!
Rubin, M. (2022) · Significance · doi:10.1111/1740-9713.01619 · Cited by 9
Contrasting roles of measurement knowledge systems in confounding or creating sustainable change
Fisher, W. P. (2022) · ACTA IMEKO · doi:10.21014/actaimeko.v11i4.1330 · Cited by 9
Essential Paul Meehl lessons for personality assessment psychology
Harkness, A. R. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20182 · Cited by 9
Another Point of View: Superiority, Noninferiority, and the Role of Active Comparators
KRAEMER, H. C. (2011) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10com06607whi · Cited by 9
Causal Explanations in Psychiatry: A Critique of Some Current Concepts
Dalén, P. (1969) · The British Journal of Psychiatry · doi:10.1192/bjp.115.519.129 · Cited by 9
Ang, H. B., & Woodside, A. G. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2017.01.005 · Cited by 9
Reflections on the Replication Corner: In Praise of Conceptual Replications
Lynch, J. G., Bradlow, E. T., Huber, J. C., & Lehmann, D. R. (2015) · Springer eBooks · doi:10.1007/978-3-031-88060-5_20 · Cited by 9
Distinction between Tests of Data or Theory: Null versus Disconfirming Results
Harcum, E. R. (1990) · The American Journal of Psychology · doi:10.2307/1423215 · Cited by 9
Hager, W., & Möller, H. (1986) · Biometrical Journal · doi:10.1002/bimj.4710280602 · Cited by 9
Counseling Research: What I Can't Help Thinking
Thoresen, C. E. (1979) · The Counseling Psychologist · doi:10.1177/001100007900800311 · Cited by 9
Rodriguez, J. E., Williams, D. R., Rast, P., & Mulder, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zw7pf · Cited by 9
Pan, J., Christoforou, R., Wiedermann, L. N., & Schweiker, M. (2025) · Building and Environment · doi:10.1016/j.buildenv.2025.113390 · Cited by 8
Beyond the BICS Essays: Envisioning a More Rigorous Preregistered Survival Study
LeBel, E. P., Augustine, K., & Rock, A. J. (2022) · Journal of Scientific Exploration · doi:10.31275/20222691 · Cited by 8
Reproducibility, replicability, robustness, and generalizability in corpus linguistics
Flanagan, J. (2025) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.24113.fla · Cited by 8
STILL AGAINST INFERENTIAL STATISTICS: REJOINDER TO NICHOLSON AND RIDGWAY
Gorard, S. A. C., & White, P. T. (2017) · Statistics Education Research Journal · doi:10.52041/serj.v16i1.217 · Cited by 8
Sanbonmatsu, D. M., Cooley, E. H., & Posavac, S. S. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101014 · Cited by 8
Issues involving the use of significant sameness in testing replications and generating knowledge
Ball, A. D., & Sawyer, A. G. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2012.05.003 · Cited by 8
Speaking on Data’s Behalf: What Researchers Say and How Audiences Choose
Chandler, J., Martínez, I. A., Finucane, M. M., Terziev, J. G., & Resch, A. M. (2019) · Evaluation Review · doi:10.1177/0193841x19834968 · Cited by 8
Is translation the problem? Some reactions to Critchfield (2011)
Branch, M. N. (2011) · The Behavior Analyst · doi:10.1007/bf03392228 · Cited by 8
A Comparison Of Equivalence Testing In Combination With Hypothesis Testing And Effect Sizes
Mecklin, C. J. (2003) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1067645160 · Cited by 8
Dickson, M., & Baird, D. (2011) · Elsevier eBooks · doi:10.1016/b978-0-444-51862-0.50006-x · Cited by 8
An Ethical Argument Against Leaving Psychologists to Their Statistical Devices
Herrera, C. D. (1996) · The Journal of Psychology · doi:10.1080/00223980.1996.9914994 · Cited by 8
Reynolds, C. R., & Horton, A. M. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0442-2_13 · Cited by 8
LIFE: International Journal of Health and Life-Sciences
Ghedadba, N., Hambaba, L., Fercha, N., Bousselsela, H., Abdessemed, S., Mokhtar, S. M. O., & Unité de Biodiversité et Valorisation des Ressources Végétales (BVRV) – Faculté des Sciences et Techniques (FST)- Université des Sciences, D. T. E. D. M. (. N. (2016) · LIFE International Journal of Health and Life-Sciences · doi:10.20319/lijhls.2016.s21.253258 · Cited by 8
The affiliation of methodology with ontology in a scientific psychology
Spackman, M. P., & Williams, R. N. (2001) · The Journal of mind and behavior · Cited by 8
Wallach, L. (1971) · Psychological Reports · doi:10.2466/pr0.1971.28.2.583 · Cited by 8
The syntax of conversational coherence
Black, A. (1988) · Discourse Processes · doi:10.1080/01638538809544712 · Cited by 8
Statistical Significance and Reporting Test Results
Rosekrans, F. M. (1969) · Journal of Marketing Research · doi:10.1177/002224376900600410 · Cited by 8
Meehl, P. E. (1983) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 8
Self-citationThe Flatland Fallacy: Moving Beyond Low Dimensional ThinkingPreprint
Jolly, E., & Chang, L. J. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zdrfg · Cited by 8
The importance of making assumptions : why confirmation is not necessarily a bias.
(2026) · Warwick Research Archive Portal (University of Warwick) · Cited by 7
Teymoori, A., & Trappes, R. (2026) · Review of General Psychology · doi:10.1177/10892680261421875 · Cited by 7
Can psychology learn from the natural sciences?
Gigerenzer, G. (2024) · Theory & Psychology · doi:10.1177/09593543231209342 · Cited by 7
REACT to NHST: Sensible conclusions for meaningful hypotheses
Izbicki, R., Cabezas, L. M. C., Colugnati, F. A. B., Lassance, R. F. L., de Souza, A. A. L., & Stern, R. B. (2025) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.21.2.p043 · Cited by 7
Murillo, A. L., Kaiser, K. A., Smith, D. L., Peterson, C. M., Affuso, O., Tiwari, H. K., & Allison, D. B. (2019) · Obesity · doi:10.1002/oby.22511 · Cited by 7
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.