Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 2
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
- 10.2466/pr0.1962.11.3.639 · doi:10.2466/pr0.1962.11.3.639 · Paper page
Cited by
Items 901–1,000 of 1,001
McKibben, J. B. A. (2003) · OhioLink ETD Center (Ohio Library and Information Network)
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_4
Was ein signifikantes Ergebnis NICHT bedeutet
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_5
Alarm ohne Feuer oder Feuer ohne Alarm
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_7
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_6
Reinhart, A., & Wieczorek, J. (2014)
An analysis and test of electoral competition theory
Davis, S. K. (1980) · OhioLink ETD Center (Ohio Library and Information Network)
Thinking Clearly about Psychology V1: Matters of Public Interest
Grove, & Cicchetti (1991) · Project Muse (Johns Hopkins University)
Yasuda, T. (2017) · Institutional Repositories DataBase (IRDB) · doi:10.15002/00014253
Death and religion in a post-replication crisis world
Kavanagh, C. M. (2018) · Religion Brain & Behavior · doi:10.1080/2153599x.2017.1414708
Modulation of the central vestibular networks through aging and high-strength magnetic fields
Boegle, R. (2017) · Electronic Theses of LMU Munich (Ludwig-Maximilians-Universität München) · doi:10.5282/edoc.21111
Mindfulness and Implicit Political Intergroup Bias
Devonshire, J. (2018) · OpenCommons - UConn (University of Connecticut)
A Multi-Site Collaboration of Hostile Priming Effects-In-Principle Acceptance versionPreprint
McCarthy, R. J., Gervais, W. M., Magee, M. W., & Kosaka, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gxp7u
Time to overcome the neglect of effect sizes in teaching psychological research findings.
Hönekopp, J., & Greer, J. M. H. (2019) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000142
Issues concerning deception and informed consent in psychology experiments.
Herrera, C. D. (1997) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)
JSE 36:2 Summer 2022 Whole Issue PDF
Erickson, K. E. (2022) · Journal of Scientific Exploration · doi:10.31275/20222713
Thou Shalt Not Reject the P-valuePreprint
Chén, O. Y., Saraiva, R. G., Nagels, G., Phan, H. P., Schwantje, T., Cao, H., Gou, J., Reinen, J., Xiong, B., & Vos, M. D. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.18014.59206/1
Methodological Quality of Educational Technology Meta-analyses
Tamim, R. M., Borokhovski, E., & Bernard, R. M. (2020) · Springer eBooks · doi:10.1007/978-3-030-10576-1_113
Dvorak, T. (1996) · Knowledge Commons (Lakehead University)
Keller, L. (2020) · Refubium (Universitätsbibliothek der Freien Universität Berlin) · doi:10.17169/refubium-27917
Understanding teacher characteristics that predict ability to identify subtle cases of autism
Fulton, K. (2019) · UCL Discovery (University College London)
Keller, R. (2019) · VTechWorks (Virginia Tech)
Wallace, B., & Ross, A. (2016) · CRC Press eBooks · doi:10.1201/9780203491171-4
Validity Inquiry Through Cronbach's Lens
Yasuda, T. (2020) · Institutional Repositories DataBase (IRDB) · doi:10.15002/00023624
A Review of Confidence Intervals.
Mauk, A.-M. K. (2000)
A Non-Bayesian Approach to Scientific Inference on Treatment-EffectsPreprint
Banerjee, S., & Torgler, B. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5uwzk
Doing Science: Methods and PhilosophyPreprint
van Dongen, N. N. N. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yegvs
Establishing Construct Validity: The Cases of Risk Preference and Exploratory Factor Analysis
Steiner, M. (2021) · edoc (University of Basel) · doi:10.5451/unibas-ep82837
Gárdos, J. (2016) · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Diverse Tests on an Independent World
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0007
The Roles of Statistical Significance Testing In Research
Aliyu, R. (2013) · IOSR Journal of Research & Method in Education (IOSRJRME) · doi:10.9790/7388-0157883
Denis, D. J. (2021) · Wiley eBooks · doi:10.1002/9781119583004.refs
Experimental and Biological Approaches
(2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.011
General Analytic Considerations
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.034
Murphy, R. (2010) · Wiley eBooks · doi:10.1002/9780470977484.refs
Saint‐Mont, U. (2011) · Physica-Verlag eBooks · doi:10.1007/978-3-7908-2723-1_3
The Natural Selection of Bad Psychological ScientistsPreprint
Aarts, A. A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4176925
Dracup, C. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06341
(2006) · CRC Press eBooks · doi:10.1201/9780203491171.ch4
Editors, J. (2008) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1209616320
(1994) · Elsevier eBooks · doi:10.1016/b978-0-12-488440-3.50014-5
(1973) · Elsevier eBooks · doi:10.1016/b978-0-12-077150-9.50022-8
(1968) · Studia Logica · doi:10.1007/bf02124641
Denis, D. J. (2014) · Springer eBooks · doi:10.1007/978-1-4614-5583-7_631
D’Agostino, F. (2019) · Oxford University Press eBooks · doi:10.1093/obo/9780195396577-0221
(1971) · Human Organization · doi:10.17730/humo.30.1.x265010n0867r752
Martin, J., Sugarman, J. H., & Slaney, K. L. (2015) · Wiley eBooks · doi:10.1002/9781118748213.ch1
Methodological Quality of Educational Technology Meta-Analyses
Tamim, R. M., Borokhovski, E., & Bernard, R. M. (2019) · Springer eBooks · doi:10.1007/978-3-319-60013-0_113-1
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_9
Editors, J. (2003) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1051747200
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0009
When numbers fail: Do researchers agree on operationalisation of published research?Preprint
Haucke, M. N., Hoekstra, R., & van Ravenzwaaij, D. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/s6fxc
Green, C. D., Abbas, S., Belliveau, A. R., Beribisky, N., Davidson, I. A. K., DiGiovanni, J., Heidari, C., Martin, S. M., Oosenbrug, E., & Wainewright, L. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/39h47
Wright, D. B. (2005) · Wiley eBooks · doi:10.1002/0470011815.b2a08048
RamseyWard_top_down_challengesPreprint
Ramsey, R., & Ward, R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yar65
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_3
Trout, J. D. (1998) · Oxford University Press eBooks · doi:10.1093/0195107667.003.0004
Kirk, R. E. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06242
Problems of Complexity and Explanation in the Moral Sciences
Weimer, W. B. (2022) · Palgrave studies in classical liberalism · doi:10.1007/978-3-030-95477-2_1
(1998) · Oxford University Press eBooks · doi:10.1093/0195107667.002.0001
(1998) · Oxford University Press eBooks · doi:10.1093/0195107667.001.0001.002.003
(1998) · Oxford University Press eBooks · doi:10.1093/0195107667.001.0001.002.002
Aarts, A. A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4176916
A New Tool for Assessing Precise Predictions
Kwan, E., & Friendly, M. L. (2009)
Psychoanalysis as a scientific research program
Zotov, A. M. (2022) · Aspirantskiy Vestnik Povolzhiya · doi:10.55531/2072-2354.2022.22.3.27-35
Corotto, F. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-95284-2.00002-1
Corotto, F. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-95284-2.00015-x
Important things to know about null hypothesis testing
Corotto, F. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-95284-2.00005-7
Statistics Without Measurement
Weimer, W. B. (2022) · Palgrave studies in classical liberalism · doi:10.1007/978-3-031-17173-4_7
Hawthorne Works - The Shoddy Science of the Warrior of LightPreprint
Cocoș, B. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b7fr4
1 HUMAN NATURE AND THE OPEN SOCIETY
Scott‐Phillips, T. (2023) · Central European University Press eBooks · doi:10.1515/9789633865903-002
From “Modern” to “Postmodern” Psychology: Is There a Way Past?
Hanfstingl, B., Gnambs, T., Edelsbrunner, P. A., Uher, J., & Dettweiler, U. (2023) · Frontiers research topics · doi:10.3389/978-2-83251-944-8
MacGregor, O., & Tolgay, B. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/v4675
Psychology - culture, mind and the self: Some reflections on the study of mand and mind
Cawasjee, S. (2023) · Psyke & Logos · doi:10.7146/pl.v9i1.135964
Re-assessing the role of operational definitions in psychologyPreprint
Kvam, P. D., & Alaukik, A. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9tcd5
Empirische Forschung und Theorie-Entwicklung
Eisend, M., & Kuß, A. (2023) · Springer eBooks · doi:10.1007/978-3-658-42690-3_9
Hypothesen und Modelle beim Theorie-Test
Eisend, M., & Kuß, A. (2023) · Springer eBooks · doi:10.1007/978-3-658-42690-3_7
A new understanding of metaphors: From collective data to individual cases
Siman, J. H., & Sampaio, T. O. D. M. (2023) · Crossroads A Journal of English Studies · doi:10.15290/cr.2023.43.4.05
Towards understanding the relationship between Communion and Agency at the level of the individualPreprint
Dragon, P., Szumowska, E., Kossowska, M., & Holland, R. W. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2fw8u
Frimpong, V., & Wolfs, B. (2024) · Journal of investment, banking and finance. · doi:10.33140/jibf.02.01.16
Transparency and Open Science Practices in Research on Emerging Adulthood
Nguyen, P., & Syed, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197677797.003.0002
Are People like Metals? Essences, Identity, and Certain Sciences of Human Nature
Fedyk, M. (2025) · University of California Press eBooks · doi:10.1525/luminos.218.b
van Ravenzwaaij, D. (2025) · Collabra Psychology · doi:10.1525/collabra.129026
1 Are People like Metals? Essences, Identity, and Certain Sciences of Human Nature
Fedyk, M. (2025) · University of California Press eBooks · doi:10.1525/9780520399594-004
Pursuing Precision in Criminology: Why Ordinal Data Demand Ordinal MethodsPreprint
Brauer, J. R., & Day, J. C. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/fet4d_v2
Evaluate what is claimed to be confirmed: Initial version of a falsification assessment form (FAF)Preprint
Höfler, M., Kräplin, A., Elsherif, M. M., Schepke, M., Montefinese, M., Seetahul, Y., Sætrevik, B., Peikert, A., Varga, M. A., & Wallrich, L. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/eck8y_v1 · Cited by 1
Green, C. D., Abbas, S., Belliveau, A. R., Beribisky, N., Davidson, I. A. K., DiGiovanni, J., Heidari, C., Martin, S. M., Oosenbrug, E., & Wainewright, L. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/39h47_v1
The Flatland Fallacy: Moving Beyond Low Dimensional ThinkingPreprint
Jolly, E., & Chang, L. J. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zdrfg_v1
The Bayesian New Statistics (Public)Preprint
Kruschke, J. K., & Liddell, T. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wntsa_v1
Ahmadabad, F. G., Mahdavi, S. R., Nikoofar, A., Sadeghi, A. Z., Vazirinasab, H., Bagherzadeh, S., Esmaili, G., & Hasani, N. (2025) · International Journal of Radiation Research · doi:10.61186/ijrr.23.1.111
Brauer, J. R. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/n4xuf_v1
Replies to commentaries on Beyond Playing 20 Questions with NaturePreprint
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J. A., & Watts, D. J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xbaq8_v1
Brauer, J. R. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/n4xuf_v2
Rao–Lovric Theorem and the Paradigm Shift in Hypothesis Testing
Lovrić, M. (2025) · Springer eBooks · doi:10.1007/978-3-662-69359-9_516
Future Directions for Mathematical, Computational, & Digital Methods in Suicide ResearchPreprint
Wang, S. B., Behbehani, L. M., Hamm, S., & Hart, F. G. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9vpfu_v3
Krumbholz, F. (2025) · Springer eBooks · doi:10.1007/978-3-658-47919-0_17
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.