The New Statistics: A How‐To Guide
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Estimation, based on effect sizes (ESs) and confidence intervals (CIs), is much better than null hypothesis significance testing (NHST). I refer to estimation and meta‐analysis—which is the extension of estimation to multiple studies—as the new statistics. The techniques themselves are not new, but using them would for many psychologists be new, and a highly beneficial advance. I describe a six‐step strategy for estimation, which starts with the statement of research questions in terms of “how large?” questions, rather than the dichotomous hypotheses of NHST. I outline how to use estimation to analyse the two‐independent‐groups and paired designs, and randomised control trials. I discuss the ES measures Cohen's d and correlation, r, in relation to estimation. I describe how to interpret results published using NHST by visualising the corresponding CIs, and give guidance for adopting the new statistics, even in a world that often still expects NHST. I emphasise the value of figures that display CIs, and describe freely available software running under Microsoft Excel that assists calculation of CIs and preparation of figures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449
Self-citationBeyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
Error bars in experimental biology
Cumming, G., Fidler, F., & Vaux, D. L. (2007) · The Journal of Cell Biology · doi:10.1083/jcb.200611141 · Cited by 940
Self-citationGrissom, R. J., & Kim, J. J. (2012) · doi:10.4324/9780203803233 · Cited by 470
Misinterpretations of Significance: A Problem Students Share with Their Teachers?
Haller, H., & Krauss, S. (2002) · IPN - Institute for Science Education at the University of Kiel, Germany · doi:10.23668/psycharchives.12769 · Cited by 250
Confidence Intervals: Better Answers to Better Questions
Cumming, G., & Fidler, F. (2009) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.217.1.15 · Cited by 83
Self-citationCoulson, M. (2010) · Frontiers in Psychology · doi:10.3389/fpsyg.2010.00026 · Cited by 77
Cited by
Gonzalez-Hernandez, E., Romero, R., Campos, D., Burychka, D., Diego-Pedro, R., Baños, R., Negi, L. T., & Cebolla, A. (2018) · Integrative Cancer Therapies · doi:10.1177/1534735418772095 · Cited by 97
Telepsychology for Posttraumatic Stress Disorder: A systematic review
Bolton, A., & Dorstyn, D. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15571996 · Cited by 74
Interpretation of the p value: A national survey study in academic psychologists from Spain
Badenes-Ribera, L., Frías-Navarro, D., Monterde-i-Bort, H., & Pascual-Soler, M. (2015) · Psicothema · doi:10.7334/psicothema2014.283 · Cited by 41
“Reporting the effect size and its CIs would enhance the body of scientifi c knowledge and lead to a better understanding of the p value (Cumming, 2014, 2013; Cumming et al., 2012; Frías-Navarro et al., 2000; García-García, Ortega-Campos, & De la Fuente, 2011; Gliner et al., 2001; Monterde-i-Bort et…”
Effects of aging on the relation between episodic simulation and prosocial intentions
Gaesser, B., Dodds, H., & Schacter, D. L. (2017) · Memory · doi:10.1080/09658211.2017.1288746 · Cited by 37
Campos, D., Bretón-López, J., Botella, C., Mira, A., Castilla, D., Mor, S., Baños, R., & Quero, S. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2060-4 · Cited by 32
Metadata
- Authors
- Cumming, G.
- Venue
- Australian Psychologist
- Publisher
- Informa UK Limited
- Published
- 2013-06-01
- Volume
- 48
- Issue
- 3
- Pages
- 161-170
- ISSN
- 0005-0067 (ISSN-L)
- 1742-9544
- OpenAlex
- W1896461794
- Cited by
- 39
- References
- 7
- FWCI
- 4.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The New Statistics: A How‐To Guide. https://app.cochat.ai/papers/10.1111/ap.12018
- The paper
- Cumming, G. (2013). The New Statistics: A How‐To Guide. Australian Psychologist. https://doi.org/10.1111/ap.12018
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.