Statistical Power, P Values, Descriptive Statistics, and Effect Sizes
The DOI matches its Crossref record.
Abstract
This chapter reviews major weaknesses of relying on statistical significance p values, particularly in the case of tests comparing means such as t tests, ANOVAs and correlations. Along with a brief introduction to the notion of statistical power, followed by guides to calculating and using effect sizes and other descriptive statistics including confidence intervals. A related descriptive statistic that is considered and reported even less frequently is the CI. As an alternative, the thorough use of descriptive statistics, including effect sizes and CIs, should replace much of the statistical testing in L2 research. The main reasons for using effect sizes largely correspond to and address the flaws of NHST. However, primary researchers currently do little in the way of using effect sizes to enhance the results or, more importantly, the understanding of the variables and relationships. Both statistical and practical significance are considered and interpreted, and the results of the study are brought together via research synthesis and meta-analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
INCIDENTAL VOCABULARY ACQUISITION THROUGH VIEWING L2 TELEVISION AND FACTORS THAT AFFECT LEARNING
Peters, E., & Webb, S. (2018) · Studies in Second Language Acquisition · doi:10.1017/s0272263117000407 · Cited by 423
Marsden, E., Morgan‐Short, K., Thompson, S., & Abugaber, D. (2018) · Language Learning · doi:10.1111/lang.12286 · Cited by 268
Sato, M., & Loewen, S. (2018) · Language Learning · doi:10.1111/lang.12283 · Cited by 195
An A–Z of Applied Linguistics Research Methods
Loewen, S., & Plonsky, L. (2016) · doi:10.1007/978-1-137-40322-3 · Cited by 156
Self-citationThe effect of out-of-class exposure to English language media on learners’ vocabulary knowledge
Peters, E. (2018) · ITL - International Journal of Applied Linguistics · doi:10.1075/itl.00010.pet · Cited by 155
Metadata
- Authors
- Plonsky, L.
- Venue
- Advancing Quantitative Methods in Second Language Research
- Publisher
- Routledge
- Published
- 2015-07-03
- Pages
- 23-45
- OpenAlex
- W2523727134
- Cited by
- 95
- References
- 0
- FWCI
- 27.67
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical Power, P Values, Descriptive Statistics, and Effect Sizes. https://app.cochat.ai/papers/10.4324/9781315870908-3
- The paper
- Plonsky, L. (2015). Statistical Power, P Values, Descriptive Statistics, and Effect Sizes. Advancing Quantitative Methods in Second Language Research. https://doi.org/10.4324/9781315870908-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.