The DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Statistical methods in psychology journals: Guidelines and explanations.
Abstract
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of Cohen (1994), the Board of Scientific Affairs (BSA) of the APA convened a committee called the Task Force on Statistical Inference (TFSI) whose charge was “to elucidate some of the controversial issues surrounding applications
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Several authors have pointed out that replication is the most objective method for checking if the result of a study is reliable and this concept plays an essential role in the advance of scientific knowledge (Carver, 1978; Wilkinson and The Task Force on Statistical, Inference, 1999; Nickerson, 2000; Hubbard, 2004; Cumming, 2008; Hubbard and Lindsay, 2008; Asendorpt et al., 2013; Kline, 2013; St”
From Misconceptions of the p-value among Chilean and Italian Academic Psychologists (2016) · cites this paper as Wilkinson and The Task Force on Statistical, Inference, 1999
In the citing paper
“Reporting the effect size and its confidence intervals (CIs) could help avoid these erroneous interpretations (Kirk, 1996; Wilkinson and The Task Force on Statistical, Inference, 1999; Gliner et al., 2001; Balluerka et al., 2009; Fidler and Loftus, 2009; American Psychological Association, 2010; Coulson et al., 2010; Monterde-i-Bort et al., 2010; Hoekstra et al., 2012).”
From Misconceptions of the p-value among Chilean and Italian Academic Psychologists (2016) · cites this paper as Wilkinson and The Task Force on Statistical Inference (1999)
In the citing paper
“Furthermore, we calculated planned contrasts, which are recommended as a means to test the hypotheses in intervention studies (Wilkinson & the Task Force on Statistical Inference 1999).”
From Transfer of metacognitive skills in self-regulated learning: an experimental training study (2020) · cites this paper as Wilkinson & the Task Force on Statistical Inference 1999
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,938
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,707
(1979) · Medical Entomology and Zoology · Cited by 11,252
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858
Multivariate Density Estimation, Theory, Practice, and Visualbation
Ramsay, P. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485361 · Cited by 2,843
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Graphical Methods for Data Analysis.
Healy, M. J. R., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981587 · Cited by 2,315
Beyond the two disciplines of scientific psychology.
Cronbach, L. J. (1975) · American Psychologist · doi:10.1037/h0076829 · Cited by 2,115
Graphical Methods for Data Analysis.
Fisher, N. I., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Biometrics · doi:10.2307/2531418 · Cited by 1,982
Page, E. B., Webb, E. J., Campell, D. T., Schwart, R. D., & SECHREST, L. B. (1966) · American Educational Research Journal · doi:10.2307/1162043 · Cited by 1,971
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,856
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 2×
“Distinguishing statistical significance from theoretical significance (Kirk, 1996) will help the entire research community publish more substantial results.”
BackgroundCleveland, W. S. (1993) · Cited by 1,698
Experimenter Effects in Behavioral Research
McGuigan, F. J., & Rosenthal, R. (1968) · The American Journal of Psychology · doi:10.2307/1420816 · Cited by 1,633
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,362
Publication Manual of the American Psychological Association (4th ed.).
Gullickson, T. (1996) · Contemporary Psychology · doi:10.1037/004700 · Cited by 1,241
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,233
Contrasts and Effect Sizes in Behavioral Research
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804403 · Cited by 1,147
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 1,044
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854
What If There Were No Significance Tests?
(2013) · Psychology Press eBooks · doi:10.4324/9781315827353 · Cited by 675
Rubin, D. B. (1990) · Statistical Science · doi:10.1214/ss/1177012032 · Cited by 665
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S. F., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.3102/00346543068003350 · Cited by 630
Formal mode of statistical inference for causal effects
Rubin, D. B. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90077-8 · Cited by 483
Statistics As Principled Argument
Abelson, R. P. (2012) · Psychology Press eBooks · doi:10.4324/9781410601155 · Cited by 466
Guidelines for Statistical Reporting in Articles for Medical Journals
Bailar, J. C., & MOSTELLER, F. (1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-266 · Cited by 387
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265
Measures of effect size for categorical data.
Fleiss, J. L. (1994) · Cited by 248
The TETRAD Project: Constraint Based Aids to Causal Model Specification
Scheines, R., Spirtes, P., Glymour, C., Meek, C., & Richardson, T. S. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3301_3 · Cited by 206
The Counternull Value of an Effect Size: A New Statistic
Rosenthal, R., & Rubin, D. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00281.x · Cited by 170
On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test
Abelson, R. P. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00536.x · Cited by 141
Symptom treatment and symptom substitution in enuresis.
Baker, B. L. (1969) · Journal of Abnormal Psychology · doi:10.1037/h0027060 · Cited by 110
Holland, P. W., & Rubin, D. B. (1982) · ETS Research Report Series · doi:10.1002/j.2333-8504.1982.tb01321.x · Cited by 97
Hotelling, H. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731833 · Cited by 78
One cheer for null hypothesis significance testing.
Wainer, H. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.2.212 · Cited by 77
Thompsons, B., & Snyder, P. (1998) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1998.tb02702.x · Cited by 76
Ehrenberg, A. S. C. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479310 · Cited by 75
Data Reduction. Analysing and Interpreting Statistical Data
Gentleman, J. F., & Ehrenberg, A. S. C. (1977) · Technometrics · doi:10.2307/1267897 · Cited by 71
Haldane's Lungs: A Case Study in Path Analysis
McDonald, R. P. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3201_1 · Cited by 65
Dependence ofFRatios Sharing a Common Denominator Mean Square
Hurlburt, R. T., & Spiegel, D. K. (1976) · The American Statistician · doi:10.1080/00031305.1976.10479144 · Cited by 12
Cited by
Sorted by citations
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383
Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions
Preacher, K. J., Rucker, D. D., & Hayes, A. F. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701341316 · Cited by 9,973
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Preacher, K. J., Curran, P. J., & Bauer, D. J. (2006) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986031004437 · Cited by 5,044
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
Metadata
- Authors
- Wilkinson, L., & Task Force on Statistical Inference
- Corresponding author
- Wilkinson, Leland
- Venue
- American Psychologist
- Published
- 1999-08
- Volume
- 54
- Issue
- 8
- Pages
- 594-604
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2104818169
- Cited by
- 2,791
- References
- 52
- Citations by year
- 2026: 39 · 2025: 53 · 2024: 57 · 2023: 78 · 2022: 93 · 2021: 145 · 2020: 112 · 2019: 109 · 2018: 121 · 2017: 126 · 2016: 119 · 2015: 126 · 2014: 141 · 2013: 133 · 2012: 128
- FWCI
- 125.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- statistical inference, significance testing, statistical reporting guidelines, reporting guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
