The New Statistics: Why and How
The DOI matches its Crossref record, with a small difference in title or year; 91 of the 91 references it cites were found in a registry or an index.
Abstract
We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research literature is incomplete and untrustworthy, we need new requirements to ensure research integrity. These include prespecification of studies whenever possible, avoidance of selection and other inappropriate data-analytic practices, complete reporting, and encouragement of replication. Second, in response to renewed recognition of the severe flaws of null-hypothesis significance testing (NHST), we need to shift from reliance on NHST to estimation and other preferred techniques. The new statistics refers to recommended practices, including estimation based on effect sizes, confidence intervals, and meta-analysis. The techniques are not new, but adopting them widely would be new for many researchers, as well as highly beneficial. This article explains why the new statistics are important and offers guidance for their use. It describes an eight-step new-statistics strategy for research with integrity, which starts with formulation of research questions in estimation terms, has no place for NHST, and is aimed at building a cumulative quantitative discipline.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We applied random-effects models to fit the relations between CE and the criterion variables, following the guidelines proposed by Rosenthal (1979), Hunter and Schmidt (2004) and Cumming (2013).”
From Emotional processes, collective behavior, and social movements: A meta-analytic review of collective effervescence outcomes during collective gatherings and demonstrations (2022) · cites this paper as Cumming (2013)
In the citing paper
“The bootstrap procedure was also used to produce better estimates of p values and confidence intervals (CIs). This method is often recommended because it does not assume normally distributed data (Cumming, 2014).”
From In an Absolute State: Elevated Use of Absolutist Words Is a Marker Specific to Anxiety, Depression, and Suicidal Ideation (2018) · cites this paper as Cumming, 2014
In the citing paper
“Research on procrastination, perfectionism and their correlates has burgeoned in recent years indicating that such an update is both timely and important to gain current insights into the nomological networks of each (Cumming, 2014).”
From A Meta–Analytic and Conceptual Update on the Associations between Procrastination and Multidimensional Perfectionism (2017) · cites this paper as Cumming, 2014
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,031
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,708
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
(2007) · Cited by 10,092
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Research works printed but not linked: 2
- 10.7326/0003-4819-108-2-258 · doi:10.7326/0003-4819-108-2-258
- Kline R. B. (2013a). Beyond significance testing (2nd edition): Reader and instructor resource guide. Retrieved from tiny.cc/rklinesite
Cited by
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Moving to a World Beyond “ p < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Metadata
- Authors
- Cumming, G.
- Affiliations
- La Trobe University (AU)
- Corresponding author
- Cumming, Geoff
- ORCID
- Cumming, Geoff
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2013-11-12
- Volume
- 25
- Issue
- 1
- Pages
- 7-29
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2127875809
- Semantic Scholar
- 8ad6d501eac936c9d9b780eca017d5d1d1e59fae
- Cited by
- 3,200
- References
- 91
- Citations by year
- 2026: 231 · 2025: 225 · 2024: 220 · 2023: 220 · 2022: 271 · 2021: 309 · 2020: 306 · 2019: 255 · 2018: 288 · 2017: 260 · 2016: 236 · 2015: 238 · 2014: 135 · 2013: 4
- FWCI
- 222.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- new statistics, null hypothesis significance testing, research integrity, replication, effect size, confidence intervals, meta-analysis, cumulative science
- MeSH terms
- Data Interpretation, Statistical, Humans, Psychology, Statistics as Topic, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The New Statistics: Why and How. https://app.cochat.ai/papers/10.1177/0956797613504966
- The paper
- Cumming, G. (2014). The New Statistics: Why and How. Psychological Science. https://doi.org/10.1177/0956797613504966
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.