Statistical methods in psychology journals: Guidelines and explanations.
Abstract
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of Cohen (1994), the Board of Scientific Affairs (BSA) of the APA convened a committee called the Task Force on Statistical Inference (TFSI) whose charge was “to elucidate some of the controversial issues surrounding applications
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Replication is the most objective method for checking if the result of a study is reliable and plays an essential role in the advance of scientific knowledge.
“Several authors have pointed out that replication is the most objective method for checking if the result of a study is reliable and this concept plays an essential role in the advance of scientific knowledge (Carver, 1978; Wilkinson and The Task Force on Statistical, Inference, 1999; Nickerson, 2000; Hubbard, 2004; Cumming, 2008; Hubbard and Lindsay, 2008; Asendorpt et al., 2013; Kline, 2013; St”
From Misconceptions of the p-value among Chilean and Italian Academic Psychologists (2016) · cites this paper as Wilkinson and The Task Force on Statistical, Inference, 1999
Reporting the effect size and its confidence intervals (CIs) could help avoid these erroneous interpretations.
“Reporting the effect size and its confidence intervals (CIs) could help avoid these erroneous interpretations (Kirk, 1996; Wilkinson and The Task Force on Statistical, Inference, 1999; Gliner et al., 2001; Balluerka et al., 2009; Fidler and Loftus, 2009; American Psychological Association, 2010; Coulson et al., 2010; Monterde-i-Bort et al., 2010; Hoekstra et al., 2012).”
From Misconceptions of the p-value among Chilean and Italian Academic Psychologists (2016) · cites this paper as Wilkinson and The Task Force on Statistical Inference (1999)
Planned contrasts are recommended as a means to test the hypotheses in intervention studies.
“Furthermore, we calculated planned contrasts, which are recommended as a means to test the hypotheses in intervention studies (Wilkinson & the Task Force on Statistical Inference 1999).”
From Transfer of metacognitive skills in self-regulated learning: an experimental training study (2020) · cites this paper as Wilkinson & the Task Force on Statistical Inference 1999
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,938 · see citing works
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,707 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925 · see citing works
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · see citing works
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · see citing works
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980 · see citing works
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003 · see citing works
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657 · see citing works
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858 · see citing works
Multivariate Density Estimation, Theory, Practice, and Visualbation
Ramsay, P. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485361 · Cited by 2,843 · see citing works
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503 · see citing works
Graphical Methods for Data Analysis.
Healy, M. J. R., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981587 · Cited by 2,315 · see citing works
Beyond the two disciplines of scientific psychology.
Cronbach, L. J. (1975) · American Psychologist · doi:10.1037/h0076829 · Cited by 2,097 · see citing works
Graphical Methods for Data Analysis.
Fisher, N. I., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Biometrics · doi:10.2307/2531418 · Cited by 1,982 · see citing works
Page, E. B., Webb, E. J., Campell, D. T., Schwart, R. D., & SECHREST, L. B. (1966) · American Educational Research Journal · doi:10.2307/1162043 · Cited by 1,970 · see citing works
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,856 · see citing works
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · see citing works
Experimenter Effects in Behavioral Research
McGuigan, F. J., & Rosenthal, R. (1968) · The American Journal of Psychology · doi:10.2307/1420816 · Cited by 1,633 · see citing works
Cleveland, W. S. (1993) · Cited by 1,599 · see citing works
Publication Manual of the American Psychological Association (4th ed.).
Gullickson, T. (1996) · Contemporary Psychology · doi:10.1037/004700 · Cited by 1,241 · see citing works
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,233 · see citing works
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,191 · see citing works
Contrasts and Effect Sizes in Behavioral Research
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804403 · Cited by 1,144 · see citing works
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 1,031 · see citing works
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854 · see citing works
What If There Were No Significance Tests?
(2013) · Psychology Press eBooks · doi:10.4324/9781315827353 · Cited by 674 · see citing works
Rubin, D. B. (1990) · Statistical Science · doi:10.1214/ss/1177012032 · Cited by 665 · see citing works
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S. F., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.3102/00346543068003350 · Cited by 630 · see citing works
Formal mode of statistical inference for causal effects
Rubin, D. B. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90077-8 · Cited by 483 · see citing works
Statistics As Principled Argument
Abelson, R. P. (2012) · Psychology Press eBooks · doi:10.4324/9781410601155 · Cited by 473 · see citing works
Guidelines for Statistical Reporting in Articles for Medical Journals
Bailar, J. C., & MOSTELLER, F. (1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-266 · Cited by 387 · see citing works
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339 · see citing works
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265 · see citing works
Measures of effect size for categorical data.
Fleiss, J. L. (1994) · Cited by 248 · see citing works
The TETRAD Project: Constraint Based Aids to Causal Model Specification
Scheines, R., Spirtes, P., Glymour, C., Meek, C., & Richardson, T. S. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3301_3 · Cited by 206 · see citing works
The Counternull Value of an Effect Size: A New Statistic
Rosenthal, R., & Rubin, D. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00281.x · Cited by 170 · see citing works
On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test
Abelson, R. P. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00536.x · Cited by 141 · see citing works
Symptom treatment and symptom substitution in enuresis.
Baker, B. L. (1969) · Journal of Abnormal Psychology · doi:10.1037/h0027060 · Cited by 113 · see citing works
Holland, P. W., & Rubin, D. B. (1982) · ETS Research Report Series · doi:10.1002/j.2333-8504.1982.tb01321.x · Cited by 97 · see citing works
One cheer for null hypothesis significance testing.
Wainer, H. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.2.212 · Cited by 78 · see citing works
Hotelling, H. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731833 · Cited by 78 · see citing works
Thompsons, B., & Snyder, P. (1998) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1998.tb02702.x · Cited by 76 · see citing works
Ehrenberg, A. S. C. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479310 · Cited by 75 · see citing works
Data Reduction. Analysing and Interpreting Statistical Data
Gentleman, J. F., & Ehrenberg, A. S. C. (1977) · Technometrics · doi:10.2307/1267897 · Cited by 71 · see citing works
Haldane's Lungs: A Case Study in Path Analysis
McDonald, R. P. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3201_1 · Cited by 65 · see citing works
Dependence ofFRatios Sharing a Common Denominator Mean Square
Hurlburt, R. T., & Spiegel, D. K. (1976) · The American Statistician · doi:10.1080/00031305.1976.10479144 · Cited by 12 · see citing works
Flagged first, then by citations
1 of the 52 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383 · see citing works
Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions
Preacher, K. J., Rucker, D. D., & Hayes, A. F. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701341316 · Cited by 9,973 · see citing works
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199 · see citing works
Preacher, K. J., Curran, P. J., & Bauer, D. J. (2006) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986031004437 · Cited by 5,044 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Dunn, T. J., Baguley, T. S., & Brunsden, V. (2013) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,758 · see citing works
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538 · see citing works
Eta squared and partial eta squared as measures of effect size in educational research
Richardson, J. T. E. (2011) · Educational Research Review · doi:10.1016/j.edurev.2010.12.001 · Cited by 3,498 · see citing works
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835 · see citing works
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · see citing works
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215 · see citing works
Effect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860 · see citing works
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · see citing works
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060 · see citing works
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461 · see citing works
A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys
Cook, C., Heath, F. M., & Thompson, R. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970934 · Cited by 2,398 · see citing works
Un sistema de clasificación de los diseños de investigación en psicología
Ato, M., López-García, J. J., & Benavente, A. (2013) · Anales de Psicología · doi:10.6018/analesps.29.3.178511 · Cited by 2,254 · see citing works
Principled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208 · see citing works
A farewell to Bonferroni: the problems of low statistical power and publication bias
Nakagawa, S. (2004) · Behavioral Ecology · doi:10.1093/beheco/arh107 · Cited by 2,102 · see citing works
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,067 · see citing works
Default Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800 · see citing works
Understanding Power and Rules of Thumb for Determining Sample Sizes
VanVoorhis, C. R. W., & Morgan, B. L. (2007) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.03.2.p043 · Cited by 1,946 · see citing works
Lower bounds on sample size in structural equation modeling
Christopher Westland, J. (2010) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2010.07.003 · Cited by 1,846 · see citing works
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835 · see citing works
Recommended effect size statistics for repeated measures designs
Bakeman, R. A. (2005) · Behavior Research Methods · doi:10.3758/bf03192707 · Cited by 1,813 · see citing works
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780 · see citing works
Tsang, S., Royse, C., & Terkawi, A. (2017) · Saudi Journal of Anaesthesia · doi:10.4103/sja.sja_203_17 · Cited by 1,692 · see citing works
Olejnik, S., & Algina, J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.434 · Cited by 1,622 · see citing works
Preliminary guidelines for empirical research in software engineering
Kitchenham, B. A., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., Emam, K. E., & Rosenberg, J. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1027796 · Cited by 1,514 · see citing works
Research Methods in Psychology
Shaughnessy, J. J. (2016) · doi:10.24926/8668.2201 · Cited by 1,500 · see citing works
An introduction to modern missing data analyses
Baraldi, A. N., & Enders, C. K. (2009) · Journal of School Psychology · doi:10.1016/j.jsp.2009.10.001 · Cited by 1,464 · see citing works
How to select, calculate, and interpret effect sizes.
Durlak, J. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp004 · Cited by 1,487 · see citing works
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449 · see citing works
RMediation: An R package for mediation analysis confidence intervals
Tofighi, D., & MacKinnon, D. P. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0076-x · Cited by 1,419 · see citing works
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · see citing works
Contemporary Approaches to Assessing Mediation in Communication Research
Preacher, K. J., & Hayes, A. F. (2008) · Sage eBooks · doi:10.4135/9781452272054.n2 · Cited by 1,346 · see citing works
A Practical Guide to Calculating Cohen’s f2, a Measure of Local Effect Size, from PROC MIXED
Selya, A. S., Rose, J. S., Dierker, L. C., Hedeker, D., & Mermelstein, R. J. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00111 · Cited by 1,297 · see citing works
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L. W., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2011) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,315 · see citing works
Probing interactions in fixed and multilevel regression: Inferential and graphical techniques
Bauer, D. J., & Curran, P. J. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4003_5 · Cited by 1,506 · see citing works
Interpreting the magnitudes of correlation coefficients.
Hemphill, J. F. (2003) · American Psychologist · doi:10.1037/0003-066x.58.1.78 · Cited by 1,237 · see citing works
An improved effect size for single-case research: nonoverlap of all pairs.
Parker, R. I., & Vannest, K. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.10.006 · Cited by 1,126 · see citing works
Peugh, J., & Enders, C. K. (2004) · Review of Educational Research · doi:10.3102/00346543074004525 · Cited by 1,107 · see citing works
Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha
Henson, R. K. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069034 · Cited by 1,067 · see citing works
Impact of a Confounding Variable on a Regression Coefficient
Frank, K. A. (2000) · Sociological Methods & Research · doi:10.1177/0049124100029002001 · Cited by 1,042 · see citing works
Advances in testing the statistical significance of mediation effects.
Mallinckrodt, B. S., Abraham, W. T., Wei, M., & Russell, D. W. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.3.372 · Cited by 1,010 · see citing works
Statistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 <i>t</i> Tests
Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E.-J. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406923 · Cited by 945 · see citing works
Kelley, K., & Preacher, K. J. (2012) · Psychological Methods · doi:10.1037/a0028086 · Cited by 1,002 · see citing works
Reliability Generalization of Scores on the Spielberger State-Trait Anxiety Inventory
Barnes, L. L. B., Harp, D., & Jung, W. S. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004005 · Cited by 947 · see citing works
Attentional biases for negative interpersonal stimuli in clinical depression
Gotlib, I. H., Krasnoperova, E., Yue, D. N., & Joormann, J. (2004) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.113.1.121 · Cited by 911 · see citing works
Gigerenzer, G. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.033 · Cited by 890 · see citing works
Size of Treatment Effects and Their Importance to Clinical Research and Practice
KRAEMER, H. C., & Kupfer, D. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850 · see citing works
Sequential Analysis and Observational Methods for the Behavioral Sciences
Bakeman, R. A., & Quera, V. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9781139017343 · Cited by 845 · see citing works
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996 · see citing works
Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology
Brydges, C. R. (2019) · Innovation in Aging · doi:10.1093/geroni/igz036 · Cited by 826 · see citing works
A tutorial on a practical Bayesian alternative to null-hypothesis significance testing
Masson, M. E. J. (2011) · Behavior Research Methods · doi:10.3758/s13428-010-0049-5 · Cited by 752 · see citing works
Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Participants1, C. (2009) · The Clinical Neuropsychologist · doi:10.1080/13854040903155063 · Cited by 869 · see citing works
Vagal influence on working memory and attention
Hansen, A. L., Johnsen, B. H., & Thayer, J. F. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00073-4 · Cited by 759 · see citing works
Sherry, A. R., & Henson, R. K. (2005) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8401_09 · Cited by 768 · see citing works
An Introduction to Causal Inference
Pearl, J. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1203 · Cited by 755 · see citing works
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721 · see citing works
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · see citing works
An Aligned Rank Transform Procedure for Multifactor Contrast Tests
Elkin, L. A., Kay, M., Higgins, J. J., & Wobbrock, J. O. (2021) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3472749.3474784 · Cited by 711 · see citing works
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S. F., & Algina, J. J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 703 · see citing works
Construct Validation in Social and Personality Research
Flake, J. K., Pek, J. C. X., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 715 · see citing works
The Effects of Hot Spots Policing on Crime: An Updated Systematic Review and Meta-Analysis
Braga, A. A., Papachristos, A. V., & Hureau, D. M. (2012) · Justice Quarterly · doi:10.1080/07418825.2012.673632 · Cited by 698 · see citing works
Funder, D. C. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.197 · Cited by 699 · see citing works
Peters, G.-J. Y., Ruiter, R. A. C., & Kok, G. (2013) · Health Psychology Review · doi:10.1080/17437199.2012.703527 · Cited by 679 · see citing works
Congeneric and (Essentially) Tau-Equivalent Estimates of Score Reliability
Graham, J. M. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288165 · Cited by 689 · see citing works
Tharenou, P., Donohue, R., & Cooper, B. K. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810527 · Cited by 687 · see citing works
Handling Item-Level Missing Data: Simpler Is Just as Good
Parent, M. C. (2013) · The Counseling Psychologist · doi:10.1177/0011000012445176 · Cited by 685 · see citing works
New developments in latent variable panel analyses of longitudinal data
Little, T. D., Preacher, K. J., Selig, J. P., & Card, N. A. (2007) · International Journal of Behavioral Development · doi:10.1177/0165025407077757 · Cited by 670 · see citing works
Lang, T. A., & Altman, D. G. (2014) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2014.09.006 · Cited by 662 · see citing works
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 655 · see citing works
Standardized or simple effect size: what should be reported?
Baguley, T. (2009) · British Journal of Psychology · doi:10.1348/000712608x377117 · Cited by 619 · see citing works
Single-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630 · see citing works
Empirically derived guidelines for effect size interpretation in social psychology
Lovakov, A. V., & Рафиковна, А. Е. (2021) · European Journal of Social Psychology · doi:10.1002/ejsp.2752 · Cited by 692 · see citing works
Discovering the False Discovery Rate
Benjamini, Y. (2010) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2010.00746.x · Cited by 619 · see citing works
Handbook of Industrial, Work & Organizational Psychology
Anderson, N. R., Öneş, D. S., Sinangil, H. K., & Viswesvaran, C. (2001) · Sage eBooks · Cited by 632 · see citing works
The Other Half of the Story: Effect Size Analysis in Quantitative Research
Maher, J. M., Markey, J. C., & Ebert‐May, D. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.13-04-0082 · Cited by 628 · see citing works
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · see citing works
The fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577 · see citing works
What Improves with Increased Missing Data Imputations?
Bodner, T. E. (2008) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510802339072 · Cited by 695 · see citing works
Magerl, W., Krumova, E. K., Baron, R., Tölle, T. R., Treede, R., & Maier, C. (2010) · Pain · doi:10.1016/j.pain.2010.07.026 · Cited by 604 · see citing works
Moshagen, M., & Thielsch, M. T. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.05.006 · Cited by 611 · see citing works
Use of the Extreme Groups Approach: A Critical Reexamination and New Recommendations.
Preacher, K. J., Rucker, D. D., MacCallum, R. C., & Nicewander, W. A. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.2.178 · Cited by 732 · see citing works
Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method
Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2009.12.001 · Cited by 740 · see citing works
Putnam, S. P., Helbig, A. L., Gartstein, M. A., Rothbart, M. K., & Leerkes, E. M. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2013.841171 · Cited by 581 · see citing works
Hew, K. F., & Cheung, W. S. (2008) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2008.00900.x · Cited by 581 · see citing works
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555 · see citing works
PlotsOfData—A web app for visualizing data together with their summaries
Postma, M., & Goedhart, J. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000202 · Cited by 554 · see citing works
Quantifying construct validity: Two simple measures.
Westen, D., & Rosenthal, R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.3.608 · Cited by 543 · see citing works
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542 · see citing works
Thompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 546 · see citing works
How to Estimate and Interpret Various Effect Sizes.
Vacha‐Haase, T., & Thompson, B. (2004) · Journal of Counseling Psychology · doi:10.1037/0022-0167.51.4.473 · Cited by 538 · see citing works
Default Bayes Factors for Model Selection in Regression
Rouder, J. N., & Morey, R. D. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.734737 · Cited by 477 · see citing works
Contrasts and Correlations in Effect-Size Estimation
Rosnow, R. L., Rosenthal, R., & Rubin, D. B. (2000) · Psychological Science · doi:10.1111/1467-9280.00287 · Cited by 513 · see citing works
Crawford, J. R., Garthwaite, P. H., & Porter, S. (2010) · Cognitive Neuropsychology · doi:10.1080/02643294.2010.513967 · Cited by 503 · see citing works
Chmura Kraemer, H., Kiernan, M., Essex, M., & Kupfer, D. J. (2008) · Health Psychology · doi:10.1037/0278-6133.27.2(suppl.).s101 · Cited by 600 · see citing works
Shariff, A., Willard, A. K., Andersen, T., & Ara Norenzayan, A. (2015) · Personality and Social Psychology Review · doi:10.1177/1088868314568811 · Cited by 493 · see citing works
McCrae, R. R., Costa, P. T., Terracciano, A., Parker, W. D., Mills, C. J., De Fruyt, F., & Mervielde, I. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.6.1456 · Cited by 499 · see citing works
- Authors
- Wilkinson, L., & Task Force on Statistical Inference
- Corresponding author
- Wilkinson, Leland
- Venue
- American Psychologist
- Published
- 1999-08
- Volume
- 54
- Issue
- 8
- Pages
- 594-604
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2104818169
- Cited by
- 2,791
- References
- 52
- Citations by year
- 2026: 39 · 2025: 53 · 2024: 57 · 2023: 78 · 2022: 93 · 2021: 145 · 2020: 112 · 2019: 109 · 2018: 121 · 2017: 126 · 2016: 119 · 2015: 126 · 2014: 141 · 2013: 133 · 2012: 128
- FWCI
- 125.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- statistical inference, significance testing, statistical reporting guidelines, reporting guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
