Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Items 801–900 of 1,001
Statistische Signifikanz – inhaltliche Relevanz
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_8 · Cited by 1
Chapter 2. Experimental research: Problems and opportunities in the big-data era
Cremers, H. R. (2017) · John Benjamins Publishing Company eBooks · doi:10.1075/z.210.02cre · Cited by 1
Cavanagh, R. F., & Fisher, W. P. (2018) · Springer eBooks · doi:10.1007/978-981-10-8138-5_5 · Cited by 1
Saint‐Mont, U. (2018) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.58.4867 · Cited by 1
Az ezredforduló pszichológiája II
Pléh, C. (2019) · Iskolakultúra · doi:10.14232/iskkult.2019.10.3 · Cited by 1
That's not a Two-Sided Test! It's Two One-Sided Tests!
Rubin, M. (2020) · Significance · doi:10.1111/1740-9713.01405 · Cited by 1
IN PURSUE OF A SHORT-TERM EEG NEUROFEEDBACK THEORY: RESEARCH OUTLINE AND FIRST RESEARCH OUTCOMES
Kaplan, C. (2020) · LIFE International Journal of Health and Life-Sciences · doi:10.20319/lijhls.2020.62.4362 · Cited by 1
Wang, J., Song, Q., Xu, Y., Binbin, J. I. A., Lu, C., Chen, X., Dai, Z., Huang, Z., Li, Z., Jingxi, L. I. N., et al. (2021) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2021.00381 · Cited by 2
Empirische Forschung und Theorie-Entwicklung
Eisend, M., & Kuß, A. (2021) · Springer eBooks · doi:10.1007/978-3-658-32890-0_9 · Cited by 1
Statistische Signifikanz – was der p-Wert aussagt
Köppel, M., Eckert, K. G., & e.V., I. N. D. A. W. D. D. (2021) · B&G Bewegungstherapie und Gesundheitssport · doi:10.1055/a-1382-0614 · Cited by 1
Original Thought Experiment Paper for “C Leadership” “Towards a New Theory of Leadership”
Spina, J. D., & Spina, L. J. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80117-053-620211013 · Cited by 1
Jones, A. L. (2021) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2021.09.002 · Cited by 1
Statistical Significance Testing in Economics
Peden, W., & Sprenger, J. (2021) · Routledge eBooks · doi:10.4324/9781315739793-37 · Cited by 1
Holden, M. A., Metcalf, B., Lawford, B. J., Hinman, R. S., Boyd, M., Button, K., Collins, N. J., Cottrell, E., Henrotin, Y. E., Larsen, J. B., et al. (2022) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2022.02.541 · Cited by 1
Hypothesen und Modelle beim Theorietest
Eisend, M., & Kuß, A. (2021) · Springer eBooks · doi:10.1007/978-3-658-32890-0_7 · Cited by 1
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_2 · Cited by 1
Null hypothesis testing explained
Corotto, F. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-95284-2.00004-5 · Cited by 1
Understanding Complex Phenomena
Weimer, W. B. (2022) · Palgrave studies in classical liberalism · doi:10.1007/978-3-031-17173-4_13 · Cited by 1
Open Society Unresolved: The Contemporary Relevance of a Contested Idea
(2023) · Central European University Press eBooks · doi:10.7829/j.ctv2cw0rjr · Cited by 1
Akamatsu, D. (2022) · Kodo Keiryogaku (The Japanese Journal of Behaviormetrics) · doi:10.2333/jbhmk.49.113 · Cited by 1
Gilleland, E., Muñoz‐Esparza, D., & Turner, D. D. (2023) · Weather and Forecasting · doi:10.1175/waf-d-22-0201.1 · Cited by 1
Kelter, R. (2023) · Sankhya A · doi:10.1007/s13171-023-00321-x · Cited by 1
In models we trust: preregistration, large samples, and replication may not suffice
Spieß, M., & Jordan, P. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1266447 · Cited by 1
Crighton, D. A. (2021) · Wiley eBooks · doi:10.1002/9781394260669.ch8 · Cited by 1
Gobet, F. R. (2024) · L’Année psychologique · doi:10.3917/anpsy1.242.0215 · Cited by 1
Margoni, F., & Walkinshaw, N. (2024) · Infant Behavior and Development · doi:10.1016/j.infbeh.2024.101978 · Cited by 1
Proposal for modifying procedures for declaring significant trends in TIMSS
Braun, H. I., von Davier, M., & Chen, J. (2025) · Large-scale Assessments in Education · doi:10.1186/s40536-025-00236-z · Cited by 1
Mitä toistettavuuskriisistä pitäisi ajatella? Kymmenen suomalaistutkijaa sähköpostihaastattelussa
Heino, M., Ilmarinen, V., Leikas, S., Lipsanen, J. O., Lönnqvist, J., Olkkonen, M., Palosaari, E. J., Renvik, T. A., Saurio, K. J., & Silfver-Kuhalampi, M. (2025) · Psykologia · doi:10.62443/psykologia.v54i6.143375 · Cited by 1
A sensitivity test does everything that a significance test does, and better
Gorard, S. (2023) · Durham Research Online (Durham University) · doi:10.9790/7388-1302045056 · Cited by 1
Authenicated action and the decision to stop smoking.
Rawson, D. G. (1992) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 1
Thoughts on Meehl's Vision of Psychological Research for the Future
Maxwell, S. E., & Howard, G. S. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_10 · Cited by 1
Deficiency of education concerning the methodological issues in accepting null hypotheses
Harcum, E. R. (1990) · Contemporary Educational Psychology · doi:10.1016/0361-476x(90)90018-v · Cited by 1
ON THE TRANSDISCIPLINARY NATURE OF THE EPISTEMOLOGY OF DISCOVERY
Shames, M. L. (1991) · Zygon® · doi:10.1111/j.1467-9744.1991.tb00823.x · Cited by 1
Fisher, W. P. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1685556 · Cited by 1
Precognitive Telepathy I: On The Possibility of Distinguishing it Experimentally from Psychokinesis
Meehl, P. E. (1978) · Noûs · doi:10.2307/2214739 · Cited by 1
Self-citationStatistical Significance and Evidenced-Based Policies: A Realistic View
Stevens, T., & Olivárez, A. (n.d.) · Cited by 1
Investitionsrisiken, Kapitalstruktur und Finanzierungsverträge
Schneider, D. (1992) · Gabler Verlag eBooks · doi:10.1007/978-3-322-87506-8_3 · Cited by 1
Mendela, J. (1972) · The Psychological Record · doi:10.1007/bf03394102 · Cited by 1
Postoperative Predictors of Speech Reception in Cochlear Implant UsersPreprint
Hansen, M., Petersen, B., Ovesen, T., & Bærentsen, K. B. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wuvz4 · Cited by 1
Matthew, R. A. (2013) · eScholarship (California Digital Library) · Cited by 1
Brown, N. J. L., & Coyne, J. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/dursw · Cited by 1
Investigating Expertise in Auditing
Johnson, P., Bailey, A. D., & Meservy, R. D. (1986) · ScholarsArchive (Brigham Young University) · Cited by 1
(2020) · The Psychoanalytic Review · doi:10.1521/prev.2020.107.5.489 · Cited by 1
(2014) · Elsevier eBooks · doi:10.1016/b978-0-12-405888-0.10000-5 · Cited by 1
Argyropoulos, C., & Grieve, A. P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.00636 · Cited by 1
Heino, M. T. J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qxa4n · Cited by 1
Marcelino, R., Pasquarelli, B. N., & Sampaio, J. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02972 · Cited by 1
Advancing Organizational Science With Computational Process TheoriesPreprint
Kuljanin, G., Braun, M. T., Grand, J. A., Olenick, J. S., Chao, G., & Kozlowski, S. W. J. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/83ryt · Cited by 1
Stallworthy, I. C., DeJoseph, M. L., Padrutt, E. R., Greifer, N., & Berry, D. J. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/284mb · Cited by 1
Postoperative Predictors of Speech Reception in Cochlear Implant UsersPreprint
Hansen, M., Petersen, B., Ovesen, T., & Bærentsen, K. B. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wuvz4_v1 · Cited by 1
Evaluate what is claimed to be confirmed: Initial version of a falsification assessment form (FAF)Preprint
Höfler, M., Kräplin, A., Elsherif, M. M., Schepke, M., Montefinese, M., Seetahul, Y., Sætrevik, B., Peikert, A., Varga, M. A., & Wallrich, L. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/eck8y_v2 · Cited by 1
Brauer, J. R. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/n4xuf_v3 · Cited by 1
Epistemic Research Goals and the Role of Hypothesis Testing in Psychological ResearchPreprint
Scheel, A. M., Muijlwijk, H., & Lakens, D. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3smdk_v1 · Cited by 1
Slaney, K. L., & Graham, M. E. (2025) · Springer eBooks · doi:10.1007/978-3-031-70581-6_7-1 · Cited by 1
Sharp, P. B. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/k0va-vf32 · Cited by 1
Horsten, L. K. (2023) · Publication Server of Kaiserslautern University of Technology (Kaiserslautern University of Technology) · doi:10.26204/kluedo/7300 · Cited by 1
Koessler, R. B. (2022) · Scholarship@Western (Western University) · Cited by 1
Banking on Cooperation: Testing Evolutionary Theories of Human Cooperation via Microfinance Loans
(11189868), D. F. (2023) · Open Research Exeter (University of Exeter) · Cited by 1
Replicability: Terminology, Measuring Success, and StrategyPreprint
Stahel, W. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.19070 · Cited by 1
Improving Abductive ReasoningPreprint
He, V. F., & Puranam, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6594299 · Cited by 1
Recipes for Calibration Checks in Safety-Critical ApplicationsPreprint
Valentin, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.26479 · Cited by 1
Incentivizing Transparency in Psychological Science: Enter ScienpostingPreprint
Gullo, M. J., & O’Gorman, J. G. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2258209
Towards a New Unified Theory of Leadership
Spina, J. D., & Spina, L. J. (2010) · Herausforderungen an das Management · doi:10.1007/978-3-642-13686-3_3
Egy régi probléma újra előtérben: a nullhipotézis szignifikancia-teszt téves gyakorlata
Bárdits, A., Németh, R., & Terplán, G. (2015) · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
The clinical psychologist as science-practitioner
Long, C. G. (1995) · University of Birmingham Institutional Research Archive (University of Birmingham)
Petrocelli, J. V. (2007) · IUScholarWorks (Indiana University)
Hansen, J. M., Smith, S. M., & Geurts, M. D. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1313265
Kmetz, J. L. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.334180
The Role of Statistical And Formal Techniques in Experimental Psychology
Lories, G. (2002) · Springer eBooks · doi:10.1007/978-1-4020-4676-6_3
Bayesian Analysis of Parental Drinking Motives and Children's Adjustment
Duke, A. A. (2013) · UKnowledge (University of Kentucky)
Theron, A. L. (1983) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v0i0.350
Solanch, L. S. (1978) · American Psychologist · doi:10.1037/0003-066x.33.3.292
The shapes of our ancestors: A nonanecdotal approach
Benfer, R. A. (1975) · Reviews in Anthropology · doi:10.1080/00988157.1975.9977139
Beck, H. (1972) · Systems Research and Behavioral Science · doi:10.1002/bs.3830170508
Intentionality and the Problem of Discovery in Scientific Epistemology
Shames, M. L. (1992) · Theory & Psychology · doi:10.1177/0959354392021001
The structure of the perception and evaluation of art
Green, C. (1987) · Summit (Simon Fraser University)
Tradisionele navorsingsielkunde se epistemologiese verleentheid
Lill, J. B. V. (1989) · South African Journal of Psychology · doi:10.1177/008124638901900306
Reasons for N=l Designs in Educational Research
Nordlund, O., & Rönnberg, S. (1976) · Scandinavian Journal of Educational Research · doi:10.1080/0031383760200105
Grove, W. M., & Menton, W. H. (2015) · Wiley eBooks · doi:10.1002/9781118625392.wbecp217
The Undetectable Difference: An Experimental Look at the ‘Problem’ of p-Values
Goodman, W. M. (2010) · PhilPapers (PhilPapers Foundation)
Robinson, D. H., & Levin, J. R. (2001)
Wieringa, R. J. (2014) · Springer eBooks · doi:10.1007/978-3-662-43839-8_13
Lokshin, I. M. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2555496
Ecological congruence: evaluating the assessment of marital quality and communication
Dennis, M. B. (1987) · ThinkTech (Texas Tech University)
*Hypothesis Testing; *Statistical Significance
Frass, J., Newman, I., & Stats, R. (2001)
Impact of foreign affiliation on the livelihood of low-income rural households
Asif, F. (2016) · Dokumentenrepositorium der RUB (Ruhr University Bochum)
Measurement as Population‐Guided Estimation
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0002
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0003
Statistical Designs as Instruments
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0005
Developing and Framing Meaningful Problems
Lapsley, D. K. (2011) · Sage eBooks · doi:10.4135/9781483351377.n5
Introduction: Realism and Naturalism in the Philosophy of Science
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0001
Statistical Testing and the World's Contribution to Rationality
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0006
Failed Attempts: The Frailties of Narrative Methods
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0008
The Romantic Retreat Is Not Club Med
EPSTEIN, W. M. (2016) · Research on Social Work Practice · doi:10.1177/1049731516666330
Bayesian Statistical Analysis of Experimental Data
Winkler, R. L. (1973) · IIASA PURE (International Institute of Applied Systems Analysis)
Macroscopic Neural Theories of Cognition
Uttal, W. R. (2014) · Defense Technical Information Center (DTIC) · doi:10.21236/ada597175
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.