Theory-Testing in Psychology and Physics: A Methodological Paradox
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Items 401–500 of 1,001
The Earth is spherical (p < 0.05): alternative methods of statistical inference
Vicente, K. J., & Torenvliet, G. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220110037065 · Cited by 29
New relevance and significance measures to replace p-values
Stahel, W. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252991 · Cited by 28
A Bayesian perspective on severity: risky predictions and specific hypotheses
van Dongen, N. N. N., Sprenger, J., & Wagenmakers, E. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02069-1 · Cited by 28
Published correlational effect sizes in social and developmental psychology
Weinerová, J., Szűcs, D., & Ioannidis, J. P. A. (2022) · Royal Society Open Science · doi:10.1098/rsos.220311 · Cited by 28
Glöckner, A., Fiedler, S., & Renkewitz, F. (2018) · Psychologische Rundschau · doi:10.1026/0033-3042/a000384 · Cited by 28
Assessing Measurement Invariance Across Multiple Groups: When Is Fit Good Enough?
van Dijk, W., Schatschneider, C. W., Otaiba, S. A., & Hart, S. A. (2021) · Educational and Psychological Measurement · doi:10.1177/00131644211023567 · Cited by 27
Using p-values for the comparison of classifiers: pitfalls and alternatives
Berrar, D. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00828-1 · Cited by 27
Straightening the ‘value-laden turn’: minimising the influence of extra-scientific values in science
Stamenkovic, P. (2024) · Synthese · doi:10.1007/s11229-023-04446-2 · Cited by 27
Rubin, M. (2019) · Synthese · doi:10.1007/s11229-019-02433-0 · Cited by 27
On Splitting the Tails Unequally: a New Perspective on One-Versus Two-Tailed Tests
Braver, S. L. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500206 · Cited by 27
Psychology without p values: Data analysis at the turn of the 19th Century.
Smith, L. D., Best, L. A., Cylke, V. A., & Stubbs, D. A. (2000) · American Psychologist · doi:10.1037/0003-066x.55.2.260 · Cited by 27
Presidential Address -- 1981:N Toward a Science of Consumer Behavior
Olson, J. C. (1982) · ACR North American Advances · Cited by 27
The Shift from Significance Testing to Effect Size Estimation
Borenstein, M. (1998) · Elsevier eBooks · doi:10.1016/b0080-4270(73)00209-1 · Cited by 27
Methodological versus empirical literature: Two views on casual acceptance of the null hypothesis.
Harcum, E. R. (1990) · American Psychologist · doi:10.1037/0003-066x.45.3.404 · Cited by 26
A Primer on Bayesian Model-Averaged Meta-AnalysisPreprint
Gronau, Q. F., Heck, D. W., Berkhout, S. W., Haaf, J. M., & Wagenmakers, E. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/97qup · Cited by 26
Mathematical and Computational Modeling of Suicidal Thinking as a Complex Dynamical SystemPreprint
Wang, S. B., Robinaugh, D. J., Millner, A. J., Fortgang, R. G., Hamm, S., Barrow, C., & Nock, M. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b29cs · Cited by 27
Grossmann, I., Varnum, M. E. W., Hutcherson, C. A. C., & Mandel, D. R. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.005 · Cited by 25
Harrison, J. R., Thompson, B., & Vannest, K. J. (2009) · Review of Educational Research · doi:10.3102/0034654309331516 · Cited by 25
Will the ASA's Efforts to Improve Statistical Practice be Successful? Some Evidence to the Contrary
Hubbard, R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1497540 · Cited by 25
Open developmental science: An overview and annotated reading list
Kalandadze, T., & Hart, S. A. (2022) · Infant and Child Development · doi:10.1002/icd.2334 · Cited by 25
Carving nature at its joints: Paul Meehl's development of taxometrics.
Waller, N. G. (2006) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.115.2.210 · Cited by 25
Moshagen, M., & Hilbig, B. E. (2011) · Judgment and Decision Making · doi:10.1017/s193029750000423x · Cited by 24
Heslop, L. A., Lu, I. R. R., & Cray, D. (2009) · Journal of Consumer Behaviour · doi:10.1002/cb.283 · Cited by 24
Evolution of competitive priorities towards performance improvement: a meta-analysis
Jitpaiboon, T., Gu, Q., & Truong, D. (2016) · International Journal of Production Research · doi:10.1080/00207543.2016.1190878 · Cited by 24
Computational Models of Anxiety: Nascent Efforts and Future Directions
Sharp, P. B., & Eldar, E. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721418818441 · Cited by 24
Meehl, P. E. (2004) · Applied and Preventive Psychology · doi:10.1016/j.appsy.2004.02.001 · Cited by 24
Self-citationWhat Does It Mean to Be a Behavior Therapist?
Thoresen, C. E., & Coates, T. J. (1978) · The Counseling Psychologist · doi:10.1177/001100007800700302 · Cited by 24
The fundamental importance of method to theory
Dale, R. A. C., Warlaumont, A. S., & Johnson, K. L. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00120-5 · Cited by 23
Deconstructing the gender-equality paradox.
Ilmarinen, V., & Lönnqvist, J. (2024) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000508 · Cited by 23
Pruebas de significación y magnitud del efecto:Reflexiones y propuestas
Valera, A. C., & Sánchez‐Meca, J. (1997) · Anales de Psicología · Cited by 23
Simonton, D. K. (2014) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0035849 · Cited by 23
Poitevineau, J. (2004) · Mathématiques et sciences humaines · doi:10.4000/msh.2900 · Cited by 23
Causal and associative hypotheses in psychology: Examples from eyewitness testimony research.
Wright, D. B. (2006) · Psychology Public Policy and Law · doi:10.1037/1076-8971.12.2.190 · Cited by 23
Crises and Sequences in Collective Theory Development
Holt, R. T., & Turner, J. E. (1975) · American Political Science Review · doi:10.2307/1958416 · Cited by 23
SOUTHERN, S., & CAPRARA, R. (1984) · Progress in behavior modification · doi:10.1016/b978-0-12-535617-6.50006-8 · Cited by 23
Measuring the Effect of Stereo Deficiencies on Peripersonal Space Pointing
Batmaz, A. U., Mughrabi, M. H., Saraç, M., Machuca, M. D. B., & Stuerzlinger, W. (2023) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr55154.2023.00063 · Cited by 22
Accounting research and the significance test crisis
Johnstone, D. J. (2021) · Critical Perspectives on Accounting · doi:10.1016/j.cpa.2021.102296 · Cited by 22
Framework for evaluating statistical models in physics education research
Aiken, J. M., Bin, R. D., Lewandowski, H. J., & Caballero, M. D. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.020104 · Cited by 22
Replication is already mainstream: Lessons from small- N designs
Little, D. R., & Smith, P. L. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000766 · Cited by 22
Making Better Science, Intensively
Thoresen, C. E. (1978) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1978.tb04627.x · Cited by 22
Social Displays and the Recognition of Individuals
Simpson, M. J. A. (1973) · Springer eBooks · doi:10.1007/978-1-4615-7569-6_7 · Cited by 22
A Critical Analysis of Rational-Emotive Theory and Therapy
Mahoney, M. J. (1977) · The Counseling Psychologist · doi:10.1177/001100007700700104 · Cited by 22
Competence and Psychopathology in Development
Burt, K. B., Coatsworth, J. D., & Masten, A. S. (2016) · Wiley eBooks · doi:10.1002/9781119125556.devpsy409 · Cited by 22
Null regions: a unified conceptual framework for statistical inference
Smiley, A. H., Glazier, J. J., & Shoda, Y. (2023) · Royal Society Open Science · doi:10.1098/rsos.221328 · Cited by 21
The statistical theories of Fisher and of Neyman and Pearson: A methodological perspective
Hager, W. (2013) · Theory & Psychology · doi:10.1177/0959354312465483 · Cited by 21
Can nursing epistemology embrace p‐values?
Ou, C. H. K., Hall, W. A., & Thorne, S. E. (2017) · Nursing Philosophy · doi:10.1111/nup.12173 · Cited by 21
The Why, What, and How of Theories in IS Research
Mueller, B., & Urbach, N. (2013) · International Conference on Information Systems · Cited by 21
A New Test of Throughput Invariance in Fitts’ Law: Role of the Intercept and of Jensen’s Inequality
Olafsdottir, H., Guiard, Y., Rioul, O., & Perrault, S. T. (2012) · Electronic workshops in computing · doi:10.14236/ewic/hci2012.17 · Cited by 21
The fallacy of the null hypothesis in soft psychology
Waller, N. G. (2004) · Applied and Preventive Psychology · doi:10.1016/j.appsy.2004.02.015 · Cited by 21
Social Psychology and Cultural Analysis
Triandis, H. C. (1976) · Springer eBooks · doi:10.1007/978-1-4615-8765-1_19 · Cited by 21
Imagining what we might study if we really studied small groups from a speech perspective
Sykes, R. E. (1990) · Communication Studies · doi:10.1080/10510979009368304 · Cited by 21
(2015) · HAL · Cited by 20
Generalizability of choice architecture interventions
Szászi, B., Goldstein, D. G., Soman, D., & Michie, S. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00471-9 · Cited by 21
O’Donohue, W. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.07.006 · Cited by 20
Using accumulated knowledge to calibrate theoretical propositions
Edwards, J. R., & Christian, M. S. (2014) · Organizational Psychology Review · doi:10.1177/2041386614535131 · Cited by 20
Seeking the Holy Grail in Organizational Science: Uncovering Causality through Research Design
Hanges, P. J., & Wang, M. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199928309.013.0003 · Cited by 20
Evaluating the dimensionality of PTSD in a sample of OIF/OEF veterans.
Frankfurt, S. B., Anders, S. L., James, L. M., Engdahl, B. E., & Winskowski, A. M. (2015) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000012 · Cited by 20
About some misconceptions and the discontent with statistical tests in psychology
Hager, W. (2000) · doi:10.23668/psycharchives.12746 · Cited by 20
Bayesian Approaches to Testing a Point (“Null”) Hypothesis
Kruschke, J. K. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-405888-0.00012-x · Cited by 19
Linking computational models of two core tasks of cognitive control.
Robinson, M. M., & Steyvers, M. (2022) · Psychological Review · doi:10.1037/rev0000395 · Cited by 19
Zhang, D. C., Barratt, C. L., & Smith, R. W. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09872-0 · Cited by 20
The operationalization of general hypotheses versus the discovery of empirical laws in Psychology
Vautier, S. (2011) · Philosophia Scientae · doi:10.4000/philosophiascientiae.656 · Cited by 19
McMillan, D., Hastings, R. P., Salter, D. C., & Skuse, D. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-007-9193-0 · Cited by 19
KRAEMER, H. C., & Gibbons, R. D. (2009) · Psychiatric Annals · doi:10.3928/00485713-20090625-06 · Cited by 19
An Introduction to the Best Practices Section in the Journal of Counseling & Development
Marotta, S. A., & Watts, R. E. (2007) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2007.tb00617.x · Cited by 19
Osborne, D., Milojev, P., & Sibley, C. G. (2016) · European Journal of Social Psychology · doi:10.1002/ejsp.2182 · Cited by 19
Szűcs, D., & Ioannidis, J. P. A. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001151 · Cited by 19
Krueger, J. I., Grüning, D. J., Heck, P. R., & Freestone, D. M. (2024) · Psychological Inquiry · doi:10.1080/1047840x.2024.2366766 · Cited by 18
Stewart, A. J., Farran, E. K., Grange, J. A., Macleod, M. R., Munafo, M. R., Newton, P. P., Shanks, D. R., & Leads, T. U. I. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05883-3 · Cited by 18
Career orientations of I.S. personnel
Ginzberg, M. J., & Barondi, J. J. (1992) · ACM SIGCPR Computer Personnel · doi:10.1145/147114.147118 · Cited by 18
Roisman, G. I. (2021) · Child Development · doi:10.1111/cdev.13538 · Cited by 18
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J. A., & Watts, D. J. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/anjkm_v1 · Cited by 18
Advancing Organizational Science With Computational Process Theories
Kuljanin, G., Braun, M. T., Grand, J. A., Olenick, J. S., Chao, G. T., & Kozlowski, S. W. J. (2024) · The Leadership Quarterly · doi:10.1016/j.leaqua.2024.101797 · Cited by 17
Linking formal controls to motor carrier performance: Curvilinear and interaction effects
Saldanha, J. P., Miller, J. W., Hunt, C. S., & Mello, J. (2014) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2014.01.006 · Cited by 17
Diagnosing problems, prescribing solutions, and advancing athlete burnout research
Madigan, D. J. (2021) · Society for Transparency, Openness, and Replication in Kinesiology eBooks · doi:10.51224/b1028 · Cited by 17
A framework for analysing social sequences
King, T. (2011) · Quality & Quantity · doi:10.1007/s11135-011-9510-5 · Cited by 17
"Rules" of Evidence in Assessing the Efficacy and Effectiveness of Treatments
KRAEMER, H. C. (2003) · Developmental Neuropsychology · doi:10.1080/87565641.2003.9651916 · Cited by 17
POPULATIONS, SAMPLES AND STATISTICAL INFERENCE IN GEOGRAPHY
Summerfield, M. A. (1983) · The Professional Geographer · doi:10.1111/j.0033-0124.1983.00143.x · Cited by 17
Cavanaugh, J. C., & Morton, K. R. (1989) · Springer eBooks · doi:10.1007/978-1-4612-3594-1_5 · Cited by 17
Kirk, R. E. (2015) · Wiley eBooks · doi:10.1002/9781118445112.stat06242.pub2 · Cited by 17
Experimental power comes from powerful theories — the real problem in null hypothesis testing
Ashton, J. C. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3475-c2 · Cited by 17
Why We Need Systematic Reviews and Meta-Analyses in the Testing and Assessment Literature
Iliescu, D., Rusu, A., Greiff, S., Fokkema, M., & Scherer, R. (2022) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000705 · Cited by 18
Zloteanu, M., & Vuorre, M. (2024) · Journal of Nonverbal Behavior · doi:10.1007/s10919-024-00456-x · Cited by 16
Murphy, S. L., Merz, R., Reimann, L., & Fernández, A. (2025) · Royal Society Open Science · doi:10.1098/rsos.242167 · Cited by 16
Hinde, J. M., Bray, J. W., Aldridge, A., & Zarkin, G. A. (2015) · Medical Care · doi:10.1097/mlr.0000000000000381 · Cited by 16
Challenges and opportunities for top-down modulation research in cognitive psychology
Ramsey, R., & Ward, R. (2020) · Acta Psychologica · doi:10.1016/j.actpsy.2020.103118 · Cited by 16
t-Test: The Good, the Bad, the Ugly, & the Remedy
Zhang, G. (2009) · Middle Grades Research Journal · doi:10.1108/mgrj-09-2009-0004 · Cited by 16
Westermeyer, J. J. (1990) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952999009001571 · Cited by 16
Rationale and guidelines for empirical adversarial collaboration: AThinking & Reasoninginitiative
Rakow, T., Thompson, V. L., Ball, L. J., & Markovits, H. (2014) · Thinking & Reasoning · doi:10.1080/13546783.2015.975405 · Cited by 17
The latent structure of the Dark Triad: Unifying Machiavellianism and psychopathy
Persson, B. N. (2019) · UTUPub (University of Turku) · doi:10.13140/rg.2.2.17919.76961 · Cited by 16
What should a preregistration contain?Preprint
McPhetres, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cj5mh · Cited by 17
Kane, A. A., & Emich, K. J. (2024) · Group & Organization Management · doi:10.1177/10596011241282703 · Cited by 15
The significant difference paradigm promotes bad science
Hubbard, R., & Lindsay, R. M. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2012.05.004 · Cited by 15
Świątkowski, W., & Carrier, A. (2020) · Basic and Applied Social Psychology · doi:10.1080/01973533.2020.1792297 · Cited by 15
Hager, W. (2006) · Zeitschrift für Psychologie · doi:10.1026/0044-3409.214.1.10 · Cited by 15
Rozeboom, W. W. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20184 · Cited by 15
Saint‐Mont, U. (2012) · Theory & Psychology · doi:10.1177/0959354311429997 · Cited by 15
Fisher, W. P. (2021) · Journal of Interdisciplinary Economics · doi:10.1177/02601079211033475 · Cited by 15
The Function of Literature in Psychological Science
Flis, I. (2022) · Review of General Psychology · doi:10.1177/10892680211066466 · Cited by 15
Minimizing animal numbers: the variable-criteria sequential stopping rule.
Fitts, D. A. (2011) · PubMed · Cited by 15
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.