Mindless statistics.
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
By comparing data to national health registry data, the sample was in fact representative of the target population based on the demographic data collected.
“by comparing our data to national health registry data [54] (see Table 2) we can see that our sample was in fact representative of the target population based on the demographic data that was collected.”
From Exploring emotional well-being, spiritual, religious and personal beliefs and telomere length in chronic pain patients—A pilot study with cross-sectional design (2024) · cites this paper as [54]
The passages in “7. Meehl’s conjecture” discuss statistical significance and a personality-inventory dataset, not national health registry data. Searches for registry data, demographic comparisons, and sample representativeness found no passage addressing the cited claim. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824 · see citing works
Mackay, D. J. C. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/011 · Cited by 915 · see citing works
Do studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748 · see citing works
Self-citationSignificance Tests Die Hard: The Amazing Persistence of a Probabilistic Misconception
Falk, R., & Greenbaum, C. W. (1995) · Theory & Psychology · doi:10.1177/0959354395051004 · Cited by 279 · cited 1× · see citing works
“Falk and Greenbaum (1995) added the right alternative ( " none of the statements is correct " ) and also made Israeli students read Bakan's (1966) classical article, which warns of these illusions.”
BackgroundEven statisticians are not immune to misinterpretations of Null Hypothesis Significance Tests
Lecoutre, M., Poitevineau, J., & Lecoutre, B. (2003) · International Journal of Psychology · doi:10.1080/00207590244000250 · Cited by 86 · cited 1× · see citing works
“As I mentioned before, in contrast, I believe that some degree of illusion is necessary to keep the null ritual alive, and the empirical evidence supports this conjecture (e.g., Lecoutre et al., 2003; Tversky and Kahneman, 1971).”
Background
Flagged first, then by citations
Research works printed but not linked: 32
- Acree, M.C., 1978. Theories of Statistical Inference in Psychological Research: A Historicocritical Study. Disser- tation. University Microfilms International H790 H7000, Ann Arbor, MI. American Psychological Association, 1974. Publication Manual, 2nd ed., 3rd ed., 1983; 4th ed., 1994; 5th ed., 2001. Garamond/Pridemark Press, Baltimore, MD.
- Anderson, D.R., Burnham, K.P., Thompson, W.L., 2000. Null hypothesis testing: problems, prevalence, and an alternative. Journal of Wildlife Management 64, 912-923.
- Bakan, D., 1966. The test of significance in psychological research. Psychological Bulletin 66, 423-437.
- Czerlinski, J., Gigerenzer, G., Goldstein, D.G., 1999. How good are simple heuristics? In: Gigerenzer, G., Todd, P.M., the ABC Reading Group, Simple Heuristics That Make Us Smart. Oxford University Press, New York, pp. 97-118.
- Ferguson, L., 1959. Statistical Analysis in Psychology and Education. McGraw-Hill, New York.
- Feynman, R., 1998. The Meaning of it All: Thoughts of a Citizen-Scientist. Perseus Books, Reading, MA, pp. 80-81.
- Fidler, F., 2002. The fifth edition of the APA Publication Manual: why its statistics recommendations are so controversial. Educational and Psychological Measurement 62, 749-770.
- Fisher, R.A., 1955. Statistical methods and scientific induction. Journal of the Royal Statistical Society (B) 17, 69-77.
- Gigerenzer, G., 1987. Probabilistic thinking and the fight against subjectivity. In: Krüger, L., Gigerenzer, G., Morgan, M. (Eds.), The Probabilistic Revolution. Vol. II: ideas in the Sciences. MIT Press, Cambridge, MA, pp. 11-33.
- Gigerenzer, G., 1993. The superego, the ego, and the id in statistical reasoning. In: Keren, G., Lewis, C. (Eds.), A Handbook for Data Analysis in the Behavioral Sciences: Methodological Issues. Erlbaum, Hillsdale, NJ, pp. 311-339.
- Gigerenzer, G., 2000. Adaptive Thinking: Rationality in the Real World. Oxford University Press, New York.
- Gigerenzer, G., 2002. Calculated Risks: How to Know When Numbers Deceive You. Simon & Schuster, New York (UK edition: Reckoning with Risk: Learning to Live with Uncertainty. Penguin, London).
- Gigerenzer, G., Krauss, S., Vitouch, O., 2004. The null ritual: What you always wanted to know about null hypothesis testing but were afraid to ask. In: Kaplan, D. (Ed.), Handbook on Quantitative Methods in the Social Sciences. Sage, Thousand Oaks, CA, pp. 389-406.
- Gigerenzer, G., Swijtink, Z., Porter, T., Daston, L., Beatty, J., Krüger, L., 1989. The Empire of Chance. How Probability Changed Science and Every Day Life. Cambridge University Press, Cambridge, UK.
- Gigerenzer, G., Todd, P.M., The ABC Research Group, 1999. Simple Heuristics that Make Us Smart. Oxford University Press, New York.
- Guilford, J.P., 1942. Fundamental Statistics in Psychology and Education, 3rd ed., 1956; 6th ed., 1978 (with Fruchter, B). McGraw-Hill, New York.
- Hoffrage, U., Hertwig, R., Gigerenzer, G., 2000. Hindsight bias: a by-product of knowledge updating? Journal of Experimental Psychology: Learning, Memory, and Cognition 26, 566-581.
- Luce, R.D., 1988. The tools-to-theory hypothesis. Review of G. Gigerenzer and D.J. Murray, "Cognition as intuitive statistics". Contemporary Psychology 33, 582-583.
- McCloskey, D.N., Ziliak, S., 1996. The standard error of regression. Journal of Economic Literature 34, 97- 114.
- Meehl, P.E., 1978. Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology 46, 806-834.
- Melton, A.W., 1962. Editorial. Journal of Experimental Psychology 64, 553-557.
- Mulaik, S.A., Raju, N.S., Harshman, R.A., 1997. There is a time and a place for significance testing. In: Harlow, L.L., Mulaik, S.A., Steiger, J.H. (Eds.), What if there were no significance tests? Erlbaum, Mahwah, NJ, pp. 65-115.
- Neyman, J., 1957. Inductive behavior as a basic concept of philosophy of science. International Statistical Review 25, 7-22.
- Nickerson, R.S., 2000. Null hypothesis significance testing: a review of an old and continuing controversy. Psy- chological Methods 5, 241-301.
- Nunally, J.C., 1975. Introduction to Statistics for Psychology and Education. McGraw-Hill, New York.
- Oakes, M., 1986. Statistical Inference: A Commentary for the Social and Behavioral Sciences. Wiley, NY.
- Pollard, P., Richardson, J.T.E., 1987. On the probability of making Type I errors. Psychological Bulletin 102, 159-163.
- Roberts, S., Pashler, H., 2000. How persuasive is a good fit? A comment on theory testing. Psychological Review 107, 358-367.
- Rosenthal, R., Rubin, D.R., 1982. Comparing effect sizes of independent studies. Psychological Bulletin 92, 500-504.
- Rucci, A.J., Tweney, R.D., 1980. Analysis of variance and the "second discipline" of scientific psychology: a historical account. Psychological Bulletin 87, 166-184.
- Skinner, B.F., 1984. A Matter of Consequences. New York University Press, New York.
- Tversky, A., Kahneman, D., 1971. Belief in the law of small numbers. Psychological Bulletin 76, 105-110.
Cited by
Sorted by citations
The ASA Statement on <i>p</i> -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · see citing works
Helping Doctors and Patients Make Sense of Health Statistics
Gigerenzer, G., Gaissmaier, W., Kurz-Milcke, E., Schwartz, L. M., & Woloshin, S. (2007) · Psychological Science in the Public Interest · doi:10.1111/j.1539-6053.2008.00033.x · Cited by 1,336 · see citing works
Self-citationBayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938 · see citing works
The rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800 · see citing works
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701 · see citing works
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519 · see citing works
Cumming, G. (2008) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2008.00079.x · Cited by 451 · see citing works
Robust misinterpretation of confidence intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0572-3 · Cited by 425 · see citing works
Prediction and explanation in social systems
Hofman, J. M., Sharma, A., & Watts, D. J. (2017) · Science · doi:10.1126/science.aal3856 · Cited by 429 · see citing works
Why Hypothesis Testers Should Spend Less Time Testing Hypotheses
Scheel, A. M., Tiokhin, L., Isager, P. M., & Lakens, D. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620966795 · Cited by 382 · see citing works
“The insight that psychologists struggle to define their hypotheses will not surprise those who have criticized psychologists’ practice of null-hypothesis significance testing (NHST) as “the null ritual” (Gigerenzer, 2004).”
BackgroundIntegrating explanation and prediction in computational social science
Hofman, J. M., Watts, D. J., Athey, S., Garip, F., Griffiths, T. L., Kleinberg, J., Margetts, H., Mullainathan, S., Salganik, M. J., Vazire, S., et al. (2021) · Nature · doi:10.1038/s41586-021-03659-0 · Cited by 371 · see citing works
Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars
Mayo, D. G. (2018) · doi:10.1017/9781107286184 · Cited by 376 · see citing works
Storyline approach to the construction of regional climate change information
Shepherd, T. G. (2019) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2019.0013 · Cited by 331 · see citing works
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298 · see citing works
Giner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274 · see citing works
Rafi, Z., & Greenland, S. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01105-9 · Cited by 243 · see citing works
Quality, productivity and economic benefits of software reuse: a review of industrial studies
Mohagheghi, P., & Conradi, R. (2007) · Empirical Software Engineering · doi:10.1007/s10664-007-9040-x · Cited by 197 · see citing works
The spread of evidence-poor medicine via flawed social-network analysis
Lyons, R. (2011) · Statistics, Politics, and Policy · doi:10.2202/2151-7509.1024 · Cited by 182 · see citing works
Duff, B. R. L., & Faber, R. J. (2011) · Journal of Advertising · doi:10.2753/joa0091-3367400204 · Cited by 137 · see citing works
Significance testing in empirical finance: a critical review and assessment
Kim, J. H., & Ji, P. I. (2015) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2015.08.006 · Cited by 86 · see citing works
Rindermann, H., & Ceci, S. J. (2018) · Journal for the Education of the Gifted · doi:10.1177/0162353218799481 · Cited by 68 · see citing works
Political engagement and wellbeing among college students
Ballard, P. J., Ni, X., & Brocato, N. (2020) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2020.101209 · Cited by 61 · see citing works
Fu, Q., Hoijtink, H., & Moerbeek, M. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01408-1 · Cited by 47 · see citing works
Theobald, D. L. (2011) · Biology Direct · doi:10.1186/1745-6150-6-60 · Cited by 16 · see citing works
“Frequentist hypothesis tests (of both Fisher and Neyman-Pearson flavors) have been highly criticized and disparaged for many decades by professional statisticians [44-71].”
BackgroundChirkov, V. (2024) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2024.102009 · Cited by 10 · see citing works
Burger, T. (2023) · PROTEOMICS · doi:10.1002/pmic.202200406 · Cited by 10 · see citing works
“Then, the weight of traditions did the rest [29] so that authors have only recently started to advocate for mindful use of PHTs [26, 30].”
BackgroundManolov, R., & Onghena, P. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02230-1 · Cited by 5 · see citing works
Rönne-Petersén, L., Niemi, M., Walach, H., Lavebratt, C., Yang, L. L., Gerdle, B., Ghafouri, B., & Falkenberg, T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308924 · Cited by 4 · see citing works
- Authors
- Gigerenzer, G.
- Affiliations
- Max Planck Institute for Human Development (DE)
- Corresponding author
- Gigerenzer, Gerd
- ORCID
- Gigerenzer, Gerd
- Venue
- The Journal of Socio-Economics
- Publisher
- Elsevier BV
- Published
- 2004-11
- Volume
- 33
- Issue
- 5
- Pages
- 587-606
- ISSN
- 1053-5357 (ISSN-L)
- OpenAlex
- W4240809722
- Cited by
- 890
- References
- 6
- Citations by year
- 2026: 69 · 2025: 59 · 2024: 42 · 2023: 47 · 2022: 59 · 2021: 70 · 2020: 58 · 2019: 68 · 2018: 92 · 2017: 88 · 2016: 47 · 2015: 44 · 2014: 24 · 2013: 14 · 2012: 16
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- The Journal of Socio-Economics (publishedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- null hypothesis significance testing, statistical thinking, hypothesis testing, research practices, academic sanctions, statistics education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review