Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Items 701–800 of 1,001
Construct validity, disconfirming evidence and test-anxiety research
Pagano, D. F., & Katahn, M. (1972) · Journal of Personality · doi:10.1111/j.1467-6494.1972.tb00654.x · Cited by 4
Grant, M. J., & Rabinowitz, F. M. (1987) · Computers in Human Behavior · doi:10.1016/0747-5632(87)90024-0 · Cited by 4
On Prior Probabilities of Rejecting Statistical Hypotheses
Keuth, H. (1973) · Philosophy of Science · doi:10.1086/288563 · Cited by 4
Comment on “Ducklings imprint on the relational concept of ‘same or different’”
Hupé, J. (2017) · Science · doi:10.1126/science.aah6047 · Cited by 4
Humberg, S., Dufner, M., Schönbrodt, F. D., Utesch, K., Hutteman, R., Kuefner, A., van Zalk, M. H. W., Denissen, J. J. A., Nestler, S., & Back, M. D. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9w3bh · Cited by 4
The Hypository: Registering Hypotheses for Cumulative SciencePreprint
Moeller, J., Langener, A. M., Lafit, G., Karhulahti, V., Bastiaansen, J. A., & Bergmann, C. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5qgj7 · Cited by 4
Gates, K. M., & Hellberg, S. N. (2022) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2022.06.002 · Cited by 4
Inductive Reasoning Renewed: A Reply to Commentators
Krueger, J. I., Grüning, D. J., Heck, P. R., & Freestone, D. M. (2024) · Psychological Inquiry · doi:10.1080/1047840x.2024.2366765 · Cited by 4
Money in the Bank: Progressive Problem Shifts in Criminological SciencePreprint
Brauer, J. R., & Day, J. C. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/5af2s_v1 · Cited by 4
Experimental education research: rethinking why, how and when to use random assignment
Anders, J. (2023) · UCL Discovery (University College London) · Cited by 4
A simple, dynamic extension of temporal motivation theory
Dishop, C. R. (2019) · Journal of Mathematical Sociology · doi:10.1080/0022250x.2019.1666268 · Cited by 3
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2024) · The Journal of Psychology · doi:10.1080/00223980.2024.2324311 · Cited by 3
Syed, M., & Westberg, D. W. (2024) · Human Development · doi:10.1159/000539633 · Cited by 3
Review on Problems with Null Hypothesis Significance Testing in Dental Research and Its Alternatives
Lee, K.-H. (2013) · THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRY · doi:10.5933/jkapd.2013.40.3.223 · Cited by 3
Direct interaction with no correlation: An experimental pitfall in neural systems
Janušonis, S. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.02.012 · Cited by 3
Do we focus on process over outcome? Review of published studies in two prominent saudi journals
Alruwaili, R. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2443286 · Cited by 3
Management research and methodology
Wärneryd, K. (1985) · Scandinavian Journal of Management Studies · doi:10.1016/0281-7527(85)90011-8 · Cited by 3
The Role of Doubt in Conceiving Research: Reflections from a Career Shaped by a Dissertation
Presser, S. (2022) · Annual Review of Sociology · doi:10.1146/annurev-soc-080321-073017 · Cited by 3
Fisher, W. P. (2022) · Springer series in measurement science and technology · doi:10.1007/978-3-031-07465-3_12 · Cited by 3
Individual Differences and Research Pluralism
Turnure, J. E. (1990) · The Journal of Special Education · doi:10.1177/002246699002400207 · Cited by 3
Descriptive vs. inferential cheating
Trafimow, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00627 · Cited by 3
Seeing Your Data: Using Modern Statistical Graphics to Display and Detect Relationships.
West, S. G. (2006) · American Psychological Association eBooks · doi:10.1037/11384-009 · Cited by 3
Taking the Complexity Turn in Strategic Management Theory and Research
Brenes, E. R., Ciravegna, L., & Woodside, A. G. (2017) · Springer eBooks · doi:10.1007/978-3-319-47028-3_2 · Cited by 3
Működési zavarok és megújulási törekvések a tudományos pszichológiában, a 21. század elején
Szokolszky, Á. (2018) · Magyar Pszichológiai Szemle · doi:10.1556/0016.2018.73.4.3 · Cited by 3
Franco, V. R., Wiberg, M., & Laros, J. A. (2021) · Psychological Methods · doi:10.1037/met0000319 · Cited by 3
The use and usability of inferential techniques
Hoekstra, R. (2009) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 3
Statistics and Its Role in Psychological ResearchPreprint
Chow, S. L. (2002) · CogPrints (University of Southampton) · Cited by 3
The analysis of ordinal dispersion: A comparison of Leik's “D” with a variance formula
Cyr, A. B. (1978) · Social Science Research · doi:10.1016/0049-089x(78)90008-x · Cited by 3
On the Metamethodological Dimension of the “Expectancy Paradox”
Shames, M. L. (1979) · Philosophy of Science · doi:10.1086/288882 · Cited by 3
C haney and R uiz R evilla : S ampling M ethods : C omment 21
Rohner, R. P., & Pelto, P. J. (1970) · American Anthropologist · doi:10.1525/aa.1970.72.6.02a00250 · Cited by 3
The concept of adaptation‐level in psychological research
Vuorinen, R. (1973) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.1973.tb00116.x · Cited by 3
A natural history of mind: the role of evolutionary explanations in psychology
Durrant, R. (1998) · UC Research Repository (University of Canterbury) · doi:10.26021/7403 · Cited by 3
Assessing the Believability of Research Results Reported in the Environmental Health Matrix
Urkowitz, A. G., & Laessig, R. E. (1982) · Public Administration Review · doi:10.2307/975645 · Cited by 3
Experimental Knowledge in Cognitive Neuroscience: Evidence, Errors, and Inference
Aktunç, M. E. (2011) · VTechWorks (Virginia Tech) · Cited by 3
Witte, E. H., & Zenker, F. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/hx4fk · Cited by 3
Human nature & the open societyPreprint
Scott‐Phillips, T. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/k3cx9 · Cited by 3
Dracup, C. (2005) · Wiley eBooks · doi:10.1002/0470013192.bsa127 · Cited by 3
Why isn’t science better? Look at career incentives
Smaldino, P. E. (2016) · The Conversation · doi:10.64628/aai.wgmrhm6y4 · Cited by 3
Jr. Fisher William, P., & Pendrill, L. (2024) · De Gruyter eBooks · doi:10.1515/9783111036496-001 · Cited by 2
Future Directions for Mathematical, Computational, & Digital Methods in Suicide Research
Wang, S. B., Behbehani, L. M., Hamm, S., & Hart, F. G. (2026) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2026.2617212 · Cited by 2
What do Laboratory False Confession Paradigms Measure? A Calibration Meta-Analysis
Mourtgos, S. M., & Adams, I. T. (2026) · Journal of Quantitative Criminology · doi:10.1007/s10940-026-09687-1 · Cited by 2
Latent Variable Structural Equation Modeling: A Flexible Tool for Establishing Validity and More
Altschul, D. (2021) · Journal of Methods and Measurement in the Social Sciences · doi:10.2458/jmmss.3065 · Cited by 2
Effects of “We”-framing and partner number on 2- and 3-year-olds’ sense of commitment
Vasil, J., Provençal, M., & Tomasello, M. (2024) · Cognitive Development · doi:10.1016/j.cogdev.2024.101511 · Cited by 2
Indefensible Spaces: Policing and the Struggle for Housing
Kurwa, R. (2025) · University of California Press eBooks · doi:10.1525/luminos.235 · Cited by 2
Roles for Inferential Statistics in Educational Research
Maguire, T. O., & ROWLEY, G. L. (1992) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.1992.tb00225.x · Cited by 2
Coherently Connecting Computer and Information Literacy Classroom and Accountability Assessments
Oon, P., & Fisher, W. P. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1065/2/022010 · Cited by 2
Productive theory-ladenness in fMRI
Aktunç, M. E. (2019) · Synthese · doi:10.1007/s11229-019-02125-9 · Cited by 2
Maiers, W. (2021) · Springer eBooks · doi:10.1007/978-3-658-33632-5_25 · Cited by 2
Psychology in India: A Glance on Paradigmatic and Methodological Perspectives
Pirta, R. S., & Misra, G. (2021) · Springer eBooks · doi:10.1007/978-981-16-4705-5_24 · Cited by 2
Nalborczyk, L. (2022) · Collabra Psychology · doi:10.1525/collabra.33059 · Cited by 2
The theoretical value of understanding HRM’s financial value
Sturman, M. C., Fan, X., & Shim, H. (2023) · The International Journal of Human Resource Management · doi:10.1080/09585192.2023.2225282 · Cited by 2
Beyond binary group categorization: towards a dynamic view of human groups
Bar-On, K. K. (2024) · Philosophical Psychology · doi:10.1080/09515089.2024.2398622 · Cited by 2
Changing Practices and Priorities in Social Psychological Research Methods and Reporting
Giner‐Sorolla, R. (2025) · doi:10.70400/zutf8520 · Cited by 2
Brohmer, H., & Hoffmann, M. F. (2025) · Royal Society Open Science · doi:10.1098/rsos.250826 · Cited by 2
The Utility and Feasibility of Metric Calibration for Basic Psychological Research
LeBel, E. P. (2011) · Scholarship@Western (Western University) · Cited by 2
Stallworthy, I. C., DeJoseph, M. L., Padrutt, E. R., Greifer, N., & Berry, D. J. (2026) · Child Development · doi:10.1093/chidev/aacaf024 · Cited by 2
Issues on machine learning for prediction of classes among molecular sequences of plants and animals
Stehlík, M., Pant, B., Pant, K., & Pardasani, K. R. (2012) · AIP conference proceedings · doi:10.1063/1.4756161 · Cited by 2
Sorry everyone, but it didn't work (p = 0.06)
Davies, J. B., & Ross, A. J. (2012) · Addiction Research & Theory · doi:10.3109/16066359.2012.728261 · Cited by 2
Philosophia Scientiae. Travaux d’histoire et de philosophie des sciences
Heinzmann, G. (1999) · Cited by 2
Elegbe, J. A. (2016) · Routledge eBooks · doi:10.4324/9781315611822-7 · Cited by 2
Svyantek, D. J., & Ekeberg, S. E. (1995) · The International Journal of Organizational Analysis · doi:10.1108/eb028836 · Cited by 2
Effect of Experimenter's Expectancy in Relation to Type and Structure of the Experimental Task
Shames, M. L., & Adair, J. G. (1980) · Psychological Reports · doi:10.2466/pr0.1980.46.2.487 · Cited by 2
Kmetz, J. L. (2016) · International Journal of Business Administration · doi:10.5430/ijba.v7n3p101 · Cited by 2
Methodological Advances in Motor Learning and Development
Lohse, K. R. (2020) · Journal of Motor Learning and Development · doi:10.1123/jmld.2019-0054 · Cited by 2
BAYESOV FAKTOR: OPIS I RAZLOZI ZA UPOTREBU U PSIHOLOŠKIM ISTRAŽIVANJIMA
Lakić, S. (2019) · ГОДИШЊАК ЗА ПСИХОЛОГИЈУ · doi:10.46630/gpsi.18.2019.03 · Cited by 2
What Behavioral Scientists Are Unwilling to Accept
Petrinovich, L. F. (2021) · Journal of Methods and Measurement in the Social Sciences · doi:10.2458/jmmss.3061 · Cited by 2
Cognitive and Neurophysiological Models of Brain Asymmetry
Ocklenburg, S., & Güntürkün, O. (2022) · Symmetry · doi:10.3390/sym14050971 · Cited by 2
Heuristic Search of Heuristics
Pirrone, A., Lane, P. C. R., Bartlett, L., Javed, N., & Gobet, F. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47994-6_36 · Cited by 2
Krueger, J. I. (2024) · The American Journal of Psychology · doi:10.5406/19398298.137.1.05 · Cited by 2
Holender, D. (2008) · Psychologie du Travail et des Organisations · doi:10.1016/s1420-2530(16)30216-3 · Cited by 2
Testing Psychological Hypotheses Addressing Two Independent Variables and One Dependent Variable
Hager, W., & Hasselhorn, M. (1995) · Perceptual and Motor Skills · doi:10.2466/pms.1995.81.3f.1171 · Cited by 2
Διερεύνηση γνωστικών διεργασιών σε εκπαιδευτικά εικονικά περιβάλλοντα
Τζίμας, Ε. (2010) · doi:10.12681/eadd/22123 · Cited by 2
Fiske, D. W. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_5 · Cited by 2
Theory Corroboration and Football: Measuring Progress
Dar, R. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_4 · Cited by 2
Walker, D. A. (2004) · NASPA Journal · doi:10.2202/1949-6605.1355 · Cited by 2
Do you sincerely want to be a factor analyst
Williams, K. (2016) · Cited by 2
Statistical Power in Ergonomic Intervention Studies
Hurley, K. (2010) · UWSpace (University of Waterloo) · Cited by 2
The Bayesian New Statistics (Public)Preprint
Kruschke, J. K., & Liddell, T. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wntsa · Cited by 2
Brown, N. (2019) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.99196913 · Cited by 2
Xie, J., She, H., Chen, X., Zhang, H., & Niu, Y. (2020) · IEEE International Conference on Civil Aviation Safety and Information Technology (ICCASIT) · doi:10.1109/iccasit50869.2020.9368652 · Cited by 2
The Flatland Fallacy: Moving Beyond Low Dimensional ThinkingPreprint
Jolly, E., & Chang, L. J. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/h7pwt · Cited by 2
Meta-Analysis as a Business Research Method
Stajković, A. D., & Stajkovic, K. S. (2022) · Oxford University Press eBooks · doi:10.1093/acrefore/9780190224851.013.213 · Cited by 2
Thou Shalt Not Reject the P-valuePreprint
Chén, O. Y., Saraiva, R. G., Nagels, G., Phan, H., Schwantje, T., Cao, H., Gou, J., Reinen, J., Xiong, B., Zhi, B., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07270 · Cited by 2
Teste de Significância de Hipótese Nula na Análise do Comportamento: Problemas e recomendaçõesPreprint
Lins, B. R., & Strapasson, B. Â. (2024) · doi:10.1590/scielopreprints.7933 · Cited by 3
Monnerjahn, P. (2016) · University Library Linz repository (Johannes Kepler Universitat Linz) · Cited by 2
A Philosophical Critique of Null Hypothesis Testing.
Orey, M. A. (1989) · Journal of research and development in education · Cited by 2
Sabiote, C. R., Quiles, O. L., & Hernández, J. J. N. (2001) · Institutional Repository of the University of Granada (University of Granada) · Cited by 1
Frost, I. (2017) · Essentials · doi:10.1007/978-3-658-16258-0_1 · Cited by 1
Statistical Power: How Not to Miss What’s Right in Front of You
Buchanan, E. M. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009000796.012 · Cited by 1
Upright and inverted unfamiliar face-matching tasks – everything correlates everywhere all at once
Tree, J. J., Jones, A. L., & Kramer, R. S. S. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01725-w · Cited by 1
Comments on “Single paper meta‐analysis is unavoidable”
Wheeler, S. C., Lynch, J. G., Wegener, D. T., Pek, J. C. X., Matthews, M., & Huber, J. C. (2025) · Journal of Consumer Psychology · doi:10.1002/jcpy.70002 · Cited by 1
Evaluate what is claimed to be confirmed: Initial version of a Falsification Assessment Form (FAF)
Höfler, M., Kräplin, A., Elsherif, M. M., Schepke, M., Montefinese, M., Seetahul, Y., Sætrevik, B., Peikert, A., Varga, M. A., & Wallrich, L. (2025) · Methodology · doi:10.5964/meth.17705 · Cited by 1
Philosophy of psychology and psychiatry
Tsou, J. Y. (2025) · Routledge eBooks · doi:10.4324/9781003381051-52 · Cited by 1
Brauer, J. R. (2026) · European Journal of Criminology · doi:10.1177/14773708261499656 · Cited by 1
Gate-and-Expand: Enhancing Credible Evolution in Indigenous Management Theories
Chen, J. (2026) · Management and Organization Review · doi:10.1017/mor.2026.10142 · Cited by 1
Khashman, A., Al-Rabady, R., & Awawdeh, S. A. (2026) · Heritage · doi:10.3390/heritage9080302 · Cited by 1
Overreliance on Statistical Testing Logic in the Empirical Testing of Theories and Hypotheses
Hyun-Chul, C., & Abe, S. (2011) · Journal of Global Academy of Marketing Science · doi:10.1080/12297119.2011.9711011 · Cited by 1
Hypothesen und Modelle beim Theorietest
Eisend, M., & Kuß, A. (2016) · Springer eBooks · doi:10.1007/978-3-658-09705-9_7 · Cited by 1
Quantitative Literature Synthesis: An A Priori Method for Synthesizing Past and Future Data
Fife, D. A. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1440432 · Cited by 1
Zur Validitätsfrage in der psychologischen Diagnostik: die Reformulierung eines Problems
Lukesch, H. (1974) · PubMed · doi:10.5283/epub.2866 · Cited by 1
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.