Making friends with your data: Improving how statistics are conducted and reported 1
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Aim: This paper highlights some of the areas where there are problems with the way that statistics are conducted and reported in psychology journals. Recommendations are given for improving these problems. Sample: The choice of topics is based largely on the questions that authors, reviewers, and editors have asked in recent years. The focus is on null hypothesis significance testing (NHST), choosing a statistical test, and what should be included in results sections. Results: There are several ways to improve how statistics are reported. These should improve both the authors' and the readers' understanding of the data. Conclusions: Psychology as a discipline will improve if the way in which statistics are conducted and reported is improved. This will require effort from authors, scrutiny from reviewers, and stubbornness from editors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“For example, you should not think of gender as having a causal effect (Holland, 1986).”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229 · cited 2×
“Further reading: Efron and Gong (1983); Thompson (2002); Wright (2002b); http:// glass.ed.asu.edu/stats/analysis/ for free software that calculates confidence intervals for many measures.”
BackgroundStatistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 4×
“A second useful distinction (Kirk, 1996; Richardson, 1996) is between effects for the differences between group means and effects in terms of proportion of variation or association. There are several measures for each of these. Because all can these can be transformed into proportion of variance, some researchers say…”
BackgroundInfluentialThe case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
A paradox in the interpretation of group comparisons.
Lord, F. M. (1967) · Psychological Bulletin · doi:10.1037/h0025105 · Cited by 627
Fundamentals of Modern Statistical Methods: Substantially Improving Power and Accuracy
Wilcox, R. R. (2010) · doi:10.1007/978-1-4419-5525-8 · Cited by 404
Richardson, J. T. E. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203631 · Cited by 103 · cited 1×
“A second useful distinction (Kirk, 1996; Richardson, 1996) is between effects for the differences between group means and effects in terms of proportion of variation or association.”
Background
Cited by
Pain outcomes: A brief review of instruments and techniques
Younger, J., McCue, R., & Mackey, S. (2009) · Current Pain and Headache Reports · doi:10.1007/s11916-009-0009-x · Cited by 343
Sport involvement: A conceptual and empirical analysis
Beaton, A. A., Funk, D. C., Ridinger, L., & Jordan, J. (2011) · Sport Management Review · doi:10.1016/j.smr.2010.07.002 · Cited by 275
Using bootstrap estimation and the plug-in principle for clinical psychology data
Wright, D. B., London, K., & Field, A. P. (2011) · Journal of Experimental Psychopathology · doi:10.5127/jep.013611 · Cited by 187
Self-citationComparing groups in a before–after design: When t test and ANCOVA produce different results
Wright, D. B. (2006) · British Journal of Educational Psychology · doi:10.1348/000709905x52210 · Cited by 145
“a single right answer, which is why my advice in Wright (2003) was to use multiple approaches to describe the data if you are unsure about the research question.”
MethodSelf-citationFacial emotion recognition in patients with bipolar I and bipolar II disorder
Derntl, B., Seidel, E., Kryspin‐Exner, I., Hasmann, A., & Dobmeier, M. (2009) · British Journal of Clinical Psychology · doi:10.1348/014466509x404845 · Cited by 117
Metadata
- Authors
- Wright, D. B.
- Venue
- British Journal of Educational Psychology
- Publisher
- Wiley
- Published
- 2003-03
- Volume
- 73
- Issue
- 1
- Pages
- 123-136
- ISSN
- 0007-0998 (ISSN-L)
- 2044-8279
- OpenAlex
- W2098382395
- Cited by
- 101
- References
- 9
- FWCI
- 9.73
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making friends with your data: Improving how statistics are conducted and reported 1. https://app.cochat.ai/papers/10.1348/000709903762869950
- The paper
- Wright, D. B. (2003). Making friends with your data: Improving how statistics are conducted and reported 1. British Journal of Educational Psychology. https://doi.org/10.1348/000709903762869950
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.