The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Theory-Testing in Psychology and Physics: A Methodological Paradox
Abstract
Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by “success” is very weak, and becomes weaker with increased precision. “Statistical significance” plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental “cuteness” and a free reliance upon ad hoc explanations to avoid refutation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Meehl (1967) and Peter (1981), correlations between constructs from the same sample are highly likely, if the sample is large and reliability is given (at least to some degree).”
From Development and Validation of a Basic Psychological Needs Scale for Technology Use (2024) · cites this paper as Meehl (1967)
In the citing paper
“Why? Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends [3].”
From The natural selection of bad science (2016) · cites this paper as [3]
Citations
Cites
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
The logic of scientific discovery
(1959) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(59)90407-7 · Cited by 1,915
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,881
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Logic of Scientific Discovery, The
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n223 · Cited by 1,545
Statistics for Psychologists: An Intermediate Course
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,045
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
Research works printed but not linked: 1
- Lykken, 1966, Reports from the Research Laboratories of the Department of Psychiatry, University of Minnesota. Report No. PR-66-9
Cited by
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
A Meta-Analysis of Personality in Scientific and Artistic Creativity
Feist, G. J. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0204_5 · Cited by 2,180
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 1,947
Self-citationModel fit and model selection in structural equation modeling.
West, S. G., Taylor, A. B., & Wu, W. (2012) · Cited by 1,812
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Bayesian estimation supersedes the t-test
Kruschke, J. K. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029146 · Cited by 1,530
Statistical significance in psychological research.
Lykken, D. T. (1968) · Psychological Bulletin · doi:10.1037/h0026141 · Cited by 1,350
Kruschke, J. K., & Liddell, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1221-4 · Cited by 1,288
“Serlin and Lapsley (1985, 1993) pointed out that using a ROPE to affirm a predicted value is essential for scientific progress, and is a solution to Meehl’s paradox (e.g., Meehl, 1967, 1978, 1997).”
Construct Validity: A Review of Basic Issues and Marketing Practices
Peter, J. P. (1981) · Journal of Marketing Research · doi:10.2307/3150948 · Cited by 1,189
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
III. “Degrees of Freedom” and the Case Study
Campbell, D. T. (1975) · Comparative Political Studies · doi:10.1177/001041407500800204 · Cited by 1,060
Building Better Theory: Time and the Specification of When Things Happen
Mitchell, T. R., & James, L. R. (2001) · The Academy of Management Review · doi:10.2307/3560240 · Cited by 972
Bayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938
“For a couple of other ways of using Bayes factors, see Rouder et al. (2009) and Wetzels et al. (2011) for a suggested ‘‘default’’ Bayes factor to be used on any data where the null hypothesis is compared with a default theory (namely, the theory that effects may occur in either direction, scaled to a large standardize…”
BackgroundMethodInfluentialWhy Summaries of Research on Psychological Theories are Often Uninterpretable
Meehl, P. E. (1990) · Psychological Reports · doi:10.2466/pr0.1990.66.1.195 · Cited by 909
Self-citationThe Problem of Units and the Circumstance for POMP
Cohen, P., Cohen, J., Aiken, L. S., & West, S. G. (1999) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3403_2 · Cited by 900
The Standard Error of Regressions
McCLOSKEY, D. N., & Ziliak, S. T. (1996) · Journal of Economic Literature · Cited by 866
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“Such studies are cheap and can be farmed for significant results, especially when hypotheses only predict differences from the null, rather than precise quantitative differences and trends (Meehl, 1967).”
BackgroundSchmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Evaluating Learning Algorithms: A Classification Perspective
Japkowicz, N., & Shah, M. (2011) · doi:10.1017/cbo9780511921803 · Cited by 767
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761
Toward an Integrated Theory of Schizotaxia, Schizotypy, and Schizophrenia
Meehl, P. E. (1990) · Journal of Personality Disorders · doi:10.1521/pedi.1990.4.1.1 · Cited by 751
Self-citationEstablishment of Best Practices for Evidence for Prediction: A Review
Poldrack, R. A., Huckins, G., & Varoquaux, G. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.3671 · Cited by 738
Rejecting or Accepting Parameter Values in Bayesian Estimation
Kruschke, J. K. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771304 · Cited by 734
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
Two Is Not Always Better Than One: A Critical Evaluation of Two-System Theories
Keren, G., & Schul, Y. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01164.x · Cited by 691
(2011) · Cited by 675
Meehl, P. E. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0102_1 · Cited by 673
Self-citationHandbook of Industrial, Work & Organizational Psychology
Anderson, N. R., Öneş, D. S., Sinangil, H. K., & Viswesvaran, C. (2001) · Sage eBooks · Cited by 633
Under what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574
Bauer, D. J., & Curran, P. J. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.1.3 · Cited by 536
Factors and Taxa, Traits and Types, Differences of Degree and Differences in Kind
Meehl, P. E. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00269.x · Cited by 507
Self-citationHow Computational Modeling Can Force Theory Building in Psychological Science
Guest, O., & Martin, A. E. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620970585 · Cited by 460
Small is beautiful: In defense of the small-N design
Smith, P. L., & Little, D. R. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1451-8 · Cited by 456
The Theory Crisis in Psychology: How to Move Forward
Eronen, M. I., & Bringmann, L. F. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620970586 · Cited by 454
Pre-registration in social psychology—A discussion and suggested template
van 't Veer, A. E., & Giner-Sorolla, R. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.03.004 · Cited by 439
Making big data open: data sharing in neuroimaging
Poldrack, R. A., & Gorgolewski, K. J. (2014) · Nature Neuroscience · doi:10.1038/nn.3818 · Cited by 425
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Bayesian data analysis for newcomers
Kruschke, J. K., & Liddell, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1272-1 · Cited by 399
Potential problems with "well fitting" models.
Tomarken, A. J., & Waller, N. G. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.578 · Cited by 393
Tryon, W. W. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.371 · Cited by 391
Why Hypothesis Testers Should Spend Less Time Testing Hypotheses
Scheel, A. M., Tiokhin, L., Isager, P. M., & Lakens, D. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620966795 · Cited by 382
“The claim that many psychological theories are critically immature has been leveled against the field so often that psychological scientists may well have grown tired of it (e.g., Fiedler, 2004; Gigerenzer, 1998; Meehl, 1967, 1978, 1990; Muthukrishna & Henrich, 2019).”
BackgroundMethodKrueger, J. I., & Funder, D. C. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000081 · Cited by 372
Psychology Will Be a Much Better Science When We Change the Way We Analyze Data
Loftus, G. R. (1996) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep11512376 · Cited by 361
The relation between statistical power and inference in fMRI
Cremers, H. R., Wager, T. D., & Yarkoni, T. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184923 · Cited by 349
Zakzanis, K. K. (2001) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/16.7.653 · Cited by 346
Evaluating and Developing Theories in the Information Systems Discipline
Monash University, & Weber, R. (2012) · Journal of the Association for Information Systems · doi:10.17705/1jais.00284 · Cited by 344
On the scientific superiority of conceptual replications for scientific progress
Crandall, C. S., & Sherman, J. W. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.002 · Cited by 344
Mapping the emotional face. How individual face parts contribute to successful emotion recognition
Wegrzyn, M., Vogt, M., Kireclioglu, B., Schneider, J., & Kissler, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0177239 · Cited by 340
Lubinski, D., & Humphreys, L. G. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.107.3.385 · Cited by 336
Hartung, C. M., & Widiger, T. A. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.123.3.260 · Cited by 333
Fair Statistical Communication in HCI
Dragicevic, P. (2016) · Human–Computer Interaction Series · doi:10.1007/978-3-319-26633-6_13 · Cited by 325
Reporting effect sizes in original psychological research: A discussion and tutorial.
Pek, J., & Flora, D. B. (2018) · Psychological Methods · doi:10.1037/met0000126 · Cited by 320
Designing Experiments and Analyzing Data
Maxwell, S. E., Delaney, H. D., & Kelley, K. (2017) · Routledge eBooks · doi:10.4324/9781003476252 · Cited by 317
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
Hurlbert, S. H., & Lombardi, C. M. (2009) · Annales Zoologici Fennici · doi:10.5735/086.046.0501 · Cited by 301
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298
EARMAN, J. (1984) · University of Minnesota Press eBooks · doi:10.5749/j.cttts94f · Cited by 295
La Metodologia de los programas de investigación científica
Lakatos, I. (2026) · doi:10.5771/9789564077673 · Cited by 283
Effect sizes and p values: What should be reported and what should be replicated?
Greenwald, A., Gonzalez, R., Harris, R. J., & Guthrie, D. (1996) · Psychophysiology · doi:10.1111/j.1469-8986.1996.tb02121.x · Cited by 274
Smithson, M. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971392 · Cited by 274
Analysis of Mediating Variables in Prevention and Intervention Research: (495892006-009)
MacKinnon, D. P., & US Department of Health and Human Services; National Institute on Drug Abuse (1994) · PsycEXTRA Dataset · doi:10.1037/e495892006-009 · Cited by 273
Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction
Mayo, D. G., & Spanos, A. (2006) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axl003 · Cited by 270
Statistical Power and Effect Size in Marketing Research
Sawyer, A. G., & Ball, A. D. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800302 · Cited by 269
Inference in ecology and evolution
Stephens, P. A., Buskirk, S. W., & del Rio, C. M. (2007) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2006.12.003 · Cited by 268
Methodological Wishes for the Next Decade and How to Make Wishes Come True
Aguinis, H., & Edwards, J. R. (2014) · Journal of Management Studies · doi:10.1111/joms.12058 · Cited by 267
Meaningful Mediation Analysis: Plausible Causal Inference and Informative Communication
Pieters, R. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx081 · Cited by 266
Chemolli, E., & Gagné, M. (2014) · Psychological Assessment · doi:10.1037/a0036212 · Cited by 251
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 245
Yarkoni, T. (2019) · doi:10.31234/osf.io/jqw35 · Cited by 244
Bridging the Quantitative-Qualitative Divide in Political Science
Tarrow, S. (1995) · American Political Science Review · doi:10.2307/2082444 · Cited by 238
Edwards, J. R., & Berry, J. W. (2010) · Organizational Research Methods · doi:10.1177/1094428110380467 · Cited by 226
Rationality in psychological research: The good-enough principle.
Serlin, R. C., & Lapsley, D. K. (1985) · American Psychologist · doi:10.1037//0003-066x.40.1.73 · Cited by 217
A Unified Framework to Quantify the Credibility of Scientific Findings
LeBel, E. P., McCarthy, R. J., Earp, B. D., Elson, M., & Vanpaemel, W. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918787489 · Cited by 214
A Short (Personal) Future History of Revolution 2.0
Spellman, B. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615609918 · Cited by 213
Competence and Psychopathology in Development
Masten, A. S., Burt, K. B., & Coatsworth, J. D. (2015) · Developmental Psychopathology · doi:10.1002/9780470939406.ch19 · Cited by 213
Gilliam, W. S., & Zigler, E. F. (2000) · Early Childhood Research Quarterly · doi:10.1016/s0885-2006(01)00073-4 · Cited by 212
What Statistical Significance Testing Is, and What It Is Not
Shaver, J. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806592 · Cited by 196
Psychology and the Question of Agency
Martin, J., Sugarman, J., & Thompson, J. (2003) · State University of New York Press eBooks · doi:10.1353/book4669 · Cited by 196
Falsifikation und die Methodologie wissenschaftlicher Forschungsprogramme
Lakatos, I. (1974) · Kritik und Erkenntnisfortschritt · doi:10.1007/978-3-322-90613-7_7 · Cited by 195
Peer Review for Journals as it Stands Today—Part 1
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019003002 · Cited by 195
A phenotypic null hypothesis for the genetics of personality.
Turkheimer, E., Pettersson, E., & Horn, E. E. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143752 · Cited by 194
“This apparent success led to another problem, one that continues to be important below: With sufficiently large samples, null hypotheses are always wrong (Meehl 1967).”
BackgroundA Systems Definition of Educational Technology in Society
Luppicini, R. (2005) · Educational Technology & Society · Cited by 194
In praise of the null hypothesis statistical test.
Hagen, R. L. (1997) · American Psychologist · doi:10.1037//0003-066x.52.1.15 · Cited by 193
Mingers, J. (2005) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601980 · Cited by 193
Kennedy‐Shaffer, L. (2019) · The American Statistician · doi:10.1080/00031305.2018.1537891 · Cited by 188
To prosper, organizational psychology should … overcome methodological barriers to progress
Edwards, J. R. (2008) · Journal of Organizational Behavior · doi:10.1002/job.529 · Cited by 185
The Hubble hypothesis and the developmentalist's dilemma
RICHTERS, J. E. (1997) · Development and Psychopathology · doi:10.1017/s0954579497002022 · Cited by 185
Theory Pruning: Strategies to Reduce Our Dense Theoretical Landscape
Leavitt, K., Mitchell, T. R., & Peterson, J. (2010) · Organizational Research Methods · doi:10.1177/1094428109345156 · Cited by 185
The Importance of Research Design in Political Science
King, G., Keohane, R. O., & Verba, S. (1995) · American Political Science Review · doi:10.2307/2082445 · Cited by 185
Thomas, A., Lubarsky, S., Varpio, L., Durning, S. J., & Young, M. E. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09932-2 · Cited by 181
Reducing bias, increasing transparency and calibrating confidence with preregistration
Hardwicke, T. E., & Wagenmakers, E.-J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01497-2 · Cited by 179
Post Hoc Power: A Concept Whose Time Has Come
Onwuegbuzie, A. J., & Leech, N. L. (2004) · Understanding Statistics · doi:10.1207/s15328031us0304_1 · Cited by 177
Discovery-oriented psychotherapy research: Rationale, aims, and methods.
Mahrer, A. R. (1988) · American Psychologist · doi:10.1037//0003-066x.43.9.694 · Cited by 176
Confirmatory Factor Analysis and Scale Validation in Communication Research
Levine, T. R. (2005) · Communication Research Reports · doi:10.1080/00036810500317730 · Cited by 174
The Significance of Statistical Significance Tests in Marketing Research
Sawyer, A. G., & Peter, J. P. (1983) · Journal of Marketing Research · doi:10.1177/002224378302000203 · Cited by 174
Furman, W. C., & Shomaker, L. B. (2008) · Journal of Adolescence · doi:10.1016/j.adolescence.2007.10.007 · Cited by 174
Metadata
- Authors
- Meehl, P. E.
- Corresponding author
- Meehl, Paul E.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 1967-06
- Volume
- 34
- Issue
- 2
- Pages
- 103-115
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W1963603753
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 29 · 2025: 41 · 2024: 29 · 2023: 50 · 2022: 53 · 2021: 50 · 2020: 39 · 2019: 39 · 2018: 39 · 2017: 55 · 2016: 32 · 2015: 27 · 2014: 28 · 2013: 23 · 2012: 22
- FWCI
- 15.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Philosophy of Science (publishedVersion)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Keywords
- theory testing, corroboration, statistical significance, experimental precision, statistical power, prior probability, direction of effect, experimental design, philosophy of psychology, philosophy of physics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.