Modern robust statistical methods: An easy way to maximize the accuracy and power of your research.
Open accessAbstract
Classic parametric statistical significance tests, such as analysis of variance and least squares regression, are widely used by researchers in many disciplines, including psychology. For classic parametric tests to produce accurate results, the assumptions underlying them (e.g., normality and homoscedasticity) must be satisfied. These assumptions are rarely met when analyzing real data. The use of classic parametric methods with violated assumptions can result in the inaccurate computation of p values, effect sizes, and confidence intervals. This may lead to substantive errors in the interpretation of data. Many modern robust statistical methods alleviate the problems inherent in using parametric methods with violated assumptions, yet modern methods are rarely used by researchers. The authors examine why this is the case, arguing that most researchers are unaware of the serious limitations of classic methods and are unfamiliar with modern alternatives. A range of modern robust and rank-based significance tests suitable for analyzing a wide range of designs is introduced. Practical advice on conducting modern analyses using software such as SPSS, SAS, and R is provided. The authors conclude by discussing robust effect size indices.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Bias-corrected bootstrapped estimates with 10,000 samples were used; this approach gives a powerful mediation test and tolerates small normality departures.
“We examined the total, direct, and indirect effects of each predictor variable on outcomes using bias-corrected bootstrapped estimates (Efron & Tibshirani, 1993) based on 10,000 bootstrapped samples, which provides a powerful test of mediation (Fritz & MacKinnon, 2007) and is robust to small departures from normality (Erceg-Hurn & Mirosevich, 2008).”
From Five Facets of Mindfulness and Psychological Health: Evaluating a Psychological Model of the Mechanisms of Mindfulness (2015) · cites this paper as Erceg-Hurn & Mirosevich, 2008
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,857 · see citing works
Rank transformations as a bridge between parametric and nonparametric statistics
Conover, W. J., & Iman, R. L. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479327 · Cited by 3,922 · see citing works
Design and Analysis of Experiments in Psychology and Education.
Ehrenberg, A. S. C., & Lindquist, E. F. (1954) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2342775 · Cited by 2,646 · see citing works
Design and Analysis: A Researcher's Handbook
Morgan, J. (2005) · Technometrics · doi:10.1198/tech.2005.s329 · Cited by 2,365 · see citing works
Introduction to Robust Estimation and Hypothesis Testing
Wilcox, R. R. (2012) · Elsevier eBooks · doi:10.1016/c2010-0-67044-1 · Cited by 2,102 · see citing works
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972) · Review of Educational Research · doi:10.3102/00346543042003237 · Cited by 1,826 · see citing works
The unicorn, the normal curve, and other improbable creatures.
Micceri, T. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.156 · Cited by 1,487 · see citing works
Rank Transformations as a Bridge Between Parametric and Nonparametric Statistics
Conover, W. J., & Iman, R. L. (1981) · The American Statistician · doi:10.2307/2683975 · Cited by 1,481 · see citing works
NON-NORMALITY AND TESTS ON VARIANCES
BOX, G. E. P. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.318 · Cited by 1,302 · see citing works
King, T., D'Agostino, R., & Stephens, M. A. (1987) · Technometrics · doi:10.2307/1269472 · Cited by 1,256 · see citing works
A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong
Vargha, A., & Delaney, H. D. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025002101 · Cited by 1,164 · see citing works
A common language effect size statistic
McGraw, K. O., & Wong, S. P. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.361 · Cited by 934 · see citing works
Size of Treatment Effects and Their Importance to Clinical Research and Practice
KRAEMER, H. C., & Kupfer, D. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850 · see citing works
Variability in Reaction Time Performance of Younger and Older Adults
Hultsch, D. F., MacDonald, S. W. S., & Dixon, R. A. (2002) · The Journals of Gerontology Series B · doi:10.1093/geronb/57.2.p101 · Cited by 838 · see citing works
A Critique and Improvement of the "CL" Common Language Effect Size Statistics of McGraw and Wong
Vargha, A., Delaney, H. D., & Vargha, A. (2000) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165329 · Cited by 836 · see citing works
The effects of violations of assumptions underlying the t test.
Boneau, C. A. (1960) · Psychological Bulletin · doi:10.1037/h0041412 · Cited by 791 · see citing works
Effect sizes for research: A broad practical approach.
Grissom, R. J., & Kim, J. J. (2005) · Cited by 732 · see citing works
Robust Nonparametric Statistical Methods
Hettmansperger, T. P., & McKean, J. W. (2010) · CRC Press eBooks · doi:10.1201/b10451 · Cited by 649 · see citing works
Nonparametric analysis of longitudinal data in factorial experiments
Brunner, E., Domhof, S., & Langer, F. (2002) · Cited by 637 · see citing works
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S. F., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.3102/00346543068003350 · Cited by 630 · see citing works
Nonparametric Analysis of Longitudinal Data in Factorial Experiments
Ghosh, S. (2003) · Technometrics · doi:10.1198/tech.2003.s161 · Cited by 585 · see citing works
Nonparametric Analysis of Ordinal Data in Designed Factorial Experiments
Shah, D. A., & Madden, L. V. (2004) · Phytopathology · doi:10.1094/phyto.2004.94.1.33 · Cited by 535 · see citing works
Modern Robust Data Analysis Methods: Measures of Central Tendency.
Wilcox, R. R., & Keselman, H. J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.254 · Cited by 505 · see citing works
Harwell, M. R., Rubinstein, E. N., Hayes, W. S., & Olds, C. C. (1992) · Journal of Educational Statistics · doi:10.3102/10769986017004315 · Cited by 485 · see citing works
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.3102/00346543066004579 · Cited by 477 · see citing works
Design and analysis of experiments in psychology and education.
indicated, N. A. (1953) · Journal of Consulting Psychology · doi:10.1037/h0051055 · Cited by 477 · see citing works
Applying Contemporary Statistical Techniques
(2003) · Elsevier eBooks · doi:10.1016/b978-0-12-751541-0.x5021-4 · Cited by 421 · see citing works
Fundamentals of Modern Statistical Methods: Substantially Improving Power and Accuracy
Wilcox, R. R. (2010) · doi:10.1007/978-1-4419-5525-8 · Cited by 404 · cited 1× · see citing works
“Several prominent statisticians and researchers have described the use of classic parametric statistics in the face of assumption violations as invalid (e.g., Kezelman et al., 1998; Leech & Onwuegbuzie, 2002; Wilcox, 2001; Zimmerman, 1998).”
BackgroundIntroduction to Robust Estimation and Hypothesis Testing
Horn, P. S., & Wilcox, R. R. (1998) · Technometrics · doi:10.2307/1271402 · Cited by 401 · see citing works
Sawilowsky, S. S., & Blair, R. C. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.352 · Cited by 395 · see citing works
Statistical methods in education and psychology, 3rd ed.
Glass, G. V., & Hopkins, K. D. (1996) · Cited by 386 · see citing works
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.2307/1170654 · Cited by 371 · see citing works
Introduction to Modern Nonparametric Statistics
Higgins, J. J. (2003) · Cited by 313 · see citing works
Introduction to Modern Nonparametric Statistics
Fotopoulos, S. (2004) · Technometrics · doi:10.1198/tech.2004.s229 · Cited by 301 · see citing works
How many discoveries have been lost by ignoring modern statistical methods?
Wilcox, R. R. (1998) · American Psychologist · doi:10.1037/0003-066x.53.3.300 · Cited by 295 · see citing works
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.3.317 · Cited by 290 · see citing works
Nonparametric methods in factorial designs
Brunner, E., & PURI, M. L. (2001) · Statistical Papers · doi:10.1007/s003620000039 · Cited by 285 · see citing works
Probabilistic index: an intuitive non‐parametric approach to measuring the size of treatment effects
Ación, L., Peterson, J. J., TEMPLE, S. D., & Arndt, S. V. (2005) · Statistics in Medicine · doi:10.1002/sim.2256 · Cited by 270 · see citing works
Introduction to Robust Estimation and Hypothesis Testing (2nd ed.)
Ziegel, E. R. (2005) · Dialnet (Universidad de la Rioja) · Cited by 258 · see citing works
Jaccard, J., & Guilamo-Ramos, V. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3101_15 · Cited by 248 · see citing works
Fundamentals of Modern Statistical Methods
Wilcox, R. R. (2001) · Springer eBooks · doi:10.1007/978-1-4757-3522-2 · Cited by 227 · see citing works
Nonparametric Hypotheses and Rank Statistics for Unbalanced Factorial Designs
Akritas, M. G., Arnold, S. F., & Brunner, E. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473623 · Cited by 220 · see citing works
Probability of the superior outcome of one treatment over another.
Grissom, R. J. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.2.314 · Cited by 217 · see citing works
Robust Nonparametric Statistical Methods
Mi, J., Hettmansperger, T. P., & McKean, J. W. (1999) · Technometrics · doi:10.2307/1270999 · Cited by 210 · see citing works
Applying Contemporary Statistical Techniques
Nembhard, H. B. (2004) · Technometrics · doi:10.1198/tech.2004.s233 · Cited by 187 · see citing works
Non-Normality and Tests on Variances
Box, G. E. P. (1953) · Biometrika · doi:10.2307/2333350 · Cited by 186 · see citing works
Zimmerman, D. W. (1998) · The Journal of Experimental Education · doi:10.1080/00220979809598344 · Cited by 162 · see citing works
Nonparametric Tests of Interaction in Experimental Design
Sawilowsky, S. S. (1990) · Review of Educational Research · doi:10.3102/00346543060001091 · Cited by 162 · see citing works
A warning about median reaction time.
Miller, J. O. (1988) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.14.3.539 · Cited by 159 · see citing works
Heterogeneity of variance in clinical data.
Grissom, R. J. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.1.155 · Cited by 154 · see citing works
New monte carlo results on the robustness of the anova f, w and f statistics
Wilcox, R. R., Charlin, V. L., & Thompson, K. L. (1986) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918608812553 · Cited by 134 · see citing works
Keselman, H. J., Algina, J. J., Lix, L. M., Wilcox, R. R., & Deering, K. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.2.110 · Cited by 125 · see citing works
Statistical Reform in Psychology: Is Anything Changing?
Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., Lo, J., McMenamin, N., & Wilson, S. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01881.x · Cited by 122 · see citing works
Tests for the Normal Distribution
D’Agostino, R. B. (2017) · Routledge eBooks · doi:10.1201/9780203753064-9 · Cited by 120 · see citing works
A warning about median reaction time.
Miller, J. O. (1988) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.14.3.539 · Cited by 118 · see citing works
Heterogeneity of variance in clinical data.
Grissom, R. J. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.1.155 · Cited by 113 · see citing works
Harwell, M. R., Rubinstein, E. N., Hayes, W. S., & Olds, C. C. (1992) · Journal of Educational Statistics · doi:10.2307/1165127 · Cited by 105 · see citing works
Review of assumptions and problems in the appropriate conceptualization of effect size.
Grissom, R. J., & Kim, J. J. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.135 · Cited by 104 · see citing works
Exact Type 1 Error Rates for Robustness of Student's t Test with Unequal Variances
Ramsey, P. H. (1980) · Journal of Educational Statistics · doi:10.3102/10769986005004337 · Cited by 99 · see citing works
Rank-Based Analyses of Linear Models UsingR
Terpstra, J., & McKean, J. W. (2005) · Journal of Statistical Software · doi:10.18637/jss.v014.i07 · Cited by 96 · see citing works
A Common Situation Conducive to Bizarre Distribution Shapes
Bradley, J. V. (1977) · The American Statistician · doi:10.1080/00031305.1977.10479224 · Cited by 88 · see citing works
A Call for Greater Use of Nonparametric Statistics
Leech, N. L., & Onwuegbuzie, A. J. (2002) · Cited by 84 · see citing works
Robust Analysis of Linear Models
McKean, J. W. (2004) · Statistical Science · doi:10.1214/088342304000000549 · Cited by 84 · see citing works
Summarizing Monte Carlo Results in Methodological Research
Harwell, M. R. (1992) · Journal of Educational Statistics · doi:10.3102/10769986017004297 · Cited by 62 · see citing works
Confidence Interval Coverage for Cohen's Effect Size Statistic
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288161 · Cited by 62 · see citing works
Nonparametric Hypotheses and Rank Statistics for Unbalanced Factorial Designs
Akritas, M. G., Arnold, S. F., & Brunner, E. (1997) · Journal of the American Statistical Association · doi:10.2307/2291470 · Cited by 62 · see citing works
Jaccard, J. J., & Guilamo‐Ramos, V. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3102_13 · Cited by 61 · see citing works
Nonrobustness in Z, t, and F tests at large sample sizes
Bradley, J. V. (1980) · Bulletin of the Psychonomic Society · doi:10.3758/bf03329558 · Cited by 56 · see citing works
Zimmerman, D. W. (2000) · The Journal of General Psychology · doi:10.1080/00221300009598589 · Cited by 53 · see citing works
Twenty Nonparametric Statistics And Their Large Sample Approximations
Fahoome, G. F. (2002) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1036110540 · Cited by 50 · see citing works
Nonparametric Competitors to the Two-Way ANOVA
Toothaker, L. E., & Newman, D. (1994) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986019003237 · Cited by 46 · see citing works
Effect Sizes and their Intervals: The Two-Level Repeated Measures Case
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404268675 · Cited by 43 · see citing works
Onwuegbuzie, A. J., & Levin, J. R. (2003) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1051747920 · Cited by 34 · see citing works
Nonparametric Competitors to the Two-Way ANOVA
Toothaker, L. E., & Newman, D. (1994) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165296 · Cited by 24 · see citing works
More Powerful Tests of Predictor Subsets in Regression Analysis Under Nonnormality.
Serlin, R. C., & Harwell, M. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.492 · Cited by 23 · see citing works
Confidence Intervals For An Effect Size When Variances Are Not Equal
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2006) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1146456060 · Cited by 20 · see citing works
How many discoveries have been lost by ignoring modern statistical methods?
Wilcox, R. R. (1998) · American Psychologist · doi:10.1037//0003-066x.53.3.300 · Cited by 20 · see citing works
NONPARAMETRIC METHODS IN FACTORIAL DESIGNS
Brunner, E., & PURI, M. L. (2003) · De Gruyter eBooks · doi:10.1515/9783110917819.534 · Cited by 19 · see citing works
Rank-Based Procedures for Linear Models: Applications to Pharmaceutical Science Data
Abebe, A., Crimin, K. S., McKean, J. W., Haas, J. V., & Vidmar, T. J. (2001) · Drug Information Journal · doi:10.1177/009286150103500334 · Cited by 15 · see citing works
Latency Models for Reaction Time Distributions
Taylor, D. H. (1965) · Psychometrika · doi:10.1007/bf02289445 · Cited by 11 · see citing works
Robust General Linear Models and Graphics via a User Interface (Web RGLM)
Crimin, K. S., Abebe, A., & McKean, J. W. (2008) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1209616020 · Cited by 5 · see citing works
Review of Twenty Nonparametric Statistics and Their Large Sample Approximations.
Fahoome, G. F., & Sawilowsky, S. S. (2000) · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31, 144-152.
Cited by
Sorted by citations
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · see citing works
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461 · see citing works
Noguchi, K., Gel, Y. R., Brunner, E., & Konietschke, F. (2012) · Journal of Statistical Software · doi:10.18637/jss.v050.i12 · Cited by 1,146 · see citing works
Why Psychologists Should by Default Use Welch’s t-test Instead of Student’s t-test
Delacre, M., Lakens, D., & Leys, C. (2017) · International Review of Social Psychology · doi:10.5334/irsp.82 · Cited by 1,037 · see citing works
Statistics in Corpus Linguistics
Březina, V. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316410899 · Cited by 660 · see citing works
Pernet, C. R., Wilcox, R., & Rousselet, G. A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00606 · Cited by 566 · see citing works
Kline, R. B. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1049349 · Cited by 460 · see citing works
Diez pasos para la construcción de un test
Muñiz, J., & Fonseca-Pedrero, E. (2019) · Psicothema · doi:10.7334/psicothema2018.291 · Cited by 330 · see citing works
Connolly, C. G., Wu, J., Ho, T. C., Hoeft, F., Wolkowitz, O., Eisendrath, S., Frank, G., Hendren, R., Max, J. E., Paulus, M. P., et al. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.05.036 · Cited by 356 · see citing works
Empirical recommendations for improving the stability of the dot-probe task in clinical research.
Price, R. B., Kuckertz, J. M., Siegle, G. J., Ladouceur, C. D., Silk, J. S., Ryan, N. D., Dahl, R. E., & Amir, N. (2015) · Psychological Assessment · doi:10.1037/pas0000036 · Cited by 312 · see citing works
Delacre, M., Leys, C., Mora, Y. L., & Lakens, D. (2019) · International Review of Social Psychology · doi:10.5334/irsp.198 · Cited by 316 · see citing works
Herold, F., Wiegel, P., Scholkmann, F., Thiers, A., Hamacher, D., & Schega, L. (2017) · Neurophotonics · doi:10.1117/1.nph.4.4.041403 · Cited by 315 · see citing works
Robust Statistical Methods for Empirical Software Engineering
Kitchenham, B. A., Madeyski, L., Budgen, D., Keung, J., Pearl Brereton, A., Charters, S., Gibbs, S., & Pohthong, A. (2016) · Empirical Software Engineering · doi:10.1007/s10664-016-9437-5 · Cited by 259 · see citing works
Who gets the carrot and who gets the stick? Evidence of gender disparities in executive remuneration
Kulich, C., Trojanowski, G., Ryan, M. K., Haslam, S. A., & Renneboog, L. D. R. (2010) · Strategic Management Journal · doi:10.1002/smj.878 · Cited by 254 · see citing works
Uttley, J. (2019) · LEUKOS The Journal of the Illuminating Engineering Society of North America · doi:10.1080/15502724.2018.1533851 · Cited by 247 · see citing works
Effect of variance ratio on ANOVA robustness: Might 1.5 be the limit?
Blanca, M. J., Alarcón, R., Arnau, J., Bono, R., & Bendayan, R. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0918-2 · Cited by 231 · see citing works
Beyond differences in means: robust graphical methods to compare two groups in neuroscience
Rousselet, G. A., Pernet, C. R., & Wilcox, R. R. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13610 · Cited by 215 · see citing works
Bakker, M., & Wicherts, J. M. (2014) · Psychological Methods · doi:10.1037/met0000014 · Cited by 208 · see citing works
Early adolescent Internet game addiction in context: How parents, school, and peers impact youth
Zhu, J., Wei, Z., Yu, C., & Bao, Z. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.03.079 · Cited by 211 · see citing works
Ng, V. K. Y., & Cribbie, R. A. (2016) · Current Psychology · doi:10.1007/s12144-015-9404-0 · Cited by 180 · see citing works
Brown, D. B., Bravo, A. J., Roos, C. R., & Pearson, M. R. (2015) · Mindfulness · doi:10.1007/s12671-014-0349-4 · Cited by 178 · see citing works
The psychological assessment of risk for crime and violence.
Hanson, R. K. (2009) · Canadian Psychology/Psychologie canadienne · doi:10.1037/a0015726 · Cited by 172 · see citing works
Investigating major challenges for industry 4.0 adoption among construction companies
Demirkesen, S., & Tezel, A. (2021) · Engineering Construction & Architectural Management · doi:10.1108/ecam-12-2020-1059 · Cited by 168 · see citing works
Does Exposure to Cigarette Health Warnings Elicit Psychological Reactance in Smokers?
Erceg‐Hurn, D. M., & Steed, L. G. (2011) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2010.00710.x · Cited by 160 · see citing works
Self-citationBillieux, J., Chanal, J. P., Khazaal, Y., Rochat, L., Gay, P., ZULLINO, D. F., & der Linden, M. V. (2011) · Psychopathology · doi:10.1159/000322525 · Cited by 158 · see citing works
Zygmont, C. S., & Smith, M. R. (2014) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.10.1.p040 · Cited by 149 · see citing works
Linden, A., & Hönekopp, J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620964193 · Cited by 123 · see citing works
Introducing changes at work: How voice behavior relates to management innovation
Guzman, F. A., & Espejo, Á. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2319 · Cited by 141 · see citing works
The Cambridge Handbook of Personality Psychology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822 · Cited by 140 · see citing works
Improving university students’ web savvy: An intervention study
McGrew, S., Smith, M., Breakstone, J., Ortega, T., & Wineburg, S. (2019) · British Journal of Educational Psychology · doi:10.1111/bjep.12279 · Cited by 131 · see citing works
Asher, A. K., Portillo, C. J., Cooper, B. A., Dawson-Rose, C. S., Vlahov, D., & Page, K. (2016) · Substance Use & Misuse · doi:10.3109/10826084.2016.1161054 · Cited by 130 · see citing works
Liu, S., You, J., Ying, J., Li, X., & Shi, Q. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.083 · Cited by 124 · see citing works
Hundhammer, T., & Mussweiler, T. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028121 · Cited by 123 · see citing works
Richetin, J., Costantini, G., Perugini, M., & Schönbrodt, F. (2015) · PLoS ONE · doi:10.1371/journal.pone.0129601 · Cited by 119 · see citing works
de Melo, M. B., Daldegan‐Bueno, D., Menezes Oliveira, M. G., & de Souza, A. L. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15858 · Cited by 116 · see citing works
Resisting Everything except Temptation: Evidence and an Explanation for Domain–specific Impulsivity
Tsukayama, E., Duckworth, A. L., & Kim, B. Y. S. (2011) · European Journal of Personality · doi:10.1002/per.841 · Cited by 114 · see citing works
Bongiorno, R., Langbroek, C., Bain, P. G., Ting, M., & Ryan, M. K. (2019) · Psychology of Women Quarterly · doi:10.1177/0361684319868730 · Cited by 123 · see citing works
Kira, I. A., Ashby, J. S., Lewandowski, L., Alawneh, A. W. N., Mohanesh, J., & Odenat, L. (2013) · Psychology · doi:10.4236/psych.2013.44057 · Cited by 115 · see citing works
Kira, I. A., Lewandowski, L., Somers, C. L., Yoon, J. S., & Chiodo, L. M. (2011) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/a0022121 · Cited by 113 · see citing works
Statistics in Corpus Linguistics: A Practical Guide
Březina, V. (2018) · Cited by 110 · see citing works
The Influence of Perceived Organizational Support on Police Job Burnout: A Moderated Mediation Model
Zeng, X., Zhang, X., Chen, M., Liu, J., & Wu, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00948 · Cited by 123 · see citing works
Chen, C., Bian, F., & Zhu, Y. (2023) · BMC Public Health · doi:10.1186/s12889-023-17301-3 · Cited by 108 · see citing works
Neglected biological patterns in the residuals
Cleasby, I. R., & Nakagawa, S. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-011-1254-7 · Cited by 107 · see citing works
Galla, B. M., Plummer, B. D., White, R. E., Meketon, D., D’Mello, S. K., & Duckworth, A. L. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.08.001 · Cited by 105 · see citing works
Cowan, B. R., Branigan, H., Obregón, M., Bugis, E., & Beale, R. (2015) · Int. J. Hum. Comput. Stud. · doi:10.1016/j.ijhcs.2015.05.008 · Cited by 110 · see citing works
Kelly, J. F., Greene, M. C., Bergman, B. G., White, W. L., & Hoeppner, B. B. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14067 · Cited by 107 · see citing works
Doane, A. N., Boothe, L. G., Pearson, M. R., & Kelley, M. L. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.02.010 · Cited by 103 · see citing works
Why the resistance to statistical innovations? Bridging the communication gap.
Sharpe, D. (2013) · Psychological Methods · doi:10.1037/a0034177 · Cited by 103 · see citing works
Pernold, K., Iannello, F., Low, B. E., Rigamonti, M., Rosati, G., Scavizzi, F., Wang, J., Raspa, M., Wiles, M. V., & Ulfhake, B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211063 · Cited by 100 · see citing works
Li, D., Zhang, W., & Wang, Y. (2013) · Journal of Child and Family Studies · doi:10.1007/s10826-013-9873-4 · Cited by 99 · see citing works
Kira, I. A., Fawzi, M. H., & Fawzi, M. M. (2013) · Traumatology · doi:10.1177/1534765612459892 · Cited by 97 · see citing works
Escobar, F. B., Velasco, C., Motoki, K., Byrne, D. V., & Wang, Q. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252408 · Cited by 97 · see citing works
Michaels, J., Chaumillon, R., Nguyen-Tri, D., Watanabe, D. H., Hirsch, P., Bellavance, F., Giraudet, G., Bernardin, D., & Faubert, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185909 · Cited by 94 · see citing works
Statistical Conclusion Validity: Some Common Threats and Simple Remedies
García-Pérez, M. Á. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00325 · Cited by 94 · see citing works
Nonparametric Tests for the Interaction in Two-way Factorial Designs Using R
Feys, J. (2016) · The R Journal · doi:10.32614/rj-2016-027 · Cited by 91 · see citing works
A meta‐analysis of oceanic DMS and DMSP cycling processes: Disentangling the summer paradox
Galí, M., & Simó, R. (2015) · Global Biogeochemical Cycles · doi:10.1002/2014gb004940 · Cited by 91 · see citing works
D’Lima, G. M., Pearson, M. R., & Kelley, M. L. (2012) · Psychology of Addictive Behaviors · doi:10.1037/a0026942 · Cited by 90 · see citing works
The development of personality across the lifespan
Donnellan, M. B., & Robins, R. W. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.015 · Cited by 88 · see citing works
Assessing the utility of the willingness/prototype model in predicting help-seeking decisions.
Hammer, J. H., & Vogel, D. L. (2013) · Journal of Counseling Psychology · doi:10.1037/a0030449 · Cited by 89 · see citing works
Doane, A. N., Kelley, M. L., & Pearson, M. R. (2015) · Aggressive Behavior · doi:10.1002/ab.21610 · Cited by 89 · see citing works
Zhu, J., Yu, C., Zhang, W., Bao, Z., Jiang, Y., Chen, Y., & Zhen, S. (2016) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2016.06.008 · Cited by 88 · see citing works
Estimating Direct Rebound Effects for Personal Automotive Travel in Great Britain
Stapleton, L. M., Sorrell, S., & Schwanen, T. (2015) · Energy Economics · doi:10.1016/j.eneco.2015.12.012 · Cited by 87 · see citing works
Temperament and brain networks of attention
Posner, M. I., & Rothbart, M. K. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0254 · Cited by 87 · see citing works
Velasco, C., Woods, A. T., Hyndman, S., & Spence, C. (2015) · i-Perception · doi:10.1177/2041669515593040 · Cited by 85 · see citing works
Jacobsen, S. L., McKinney, C. H., & Holck, U. (2014) · Journal of Music Therapy · doi:10.1093/jmt/thu028 · Cited by 85 · see citing works
Remote patient monitoring acceptance trends among older adults residing in a frontier state
Giger, J. T., Pope, N. D., Vogt, H. B., Gutierrez, C., Newland, L. A., Lemke, J., & Lawler, M. J. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.11.044 · Cited by 85 · see citing works
Radović, S., Radojičić, M., Veljković, K., & Marić, M. M. (2018) · Interactive Learning Environments · doi:10.1080/10494820.2018.1512001 · Cited by 84 · see citing works
Higuchi, Y., Inagaki, M., Koyama, T., Kitamura, Y., Sendo, T., Fujimori, M., Uchitomi, Y., & Yamada, N. (2016) · BMC Public Health · doi:10.1186/s12889-016-3208-5 · Cited by 80 · see citing works
Ding, W., Shao, Y., Sun, B., Xie, R., Li, W., & Wang, X. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00814 · Cited by 91 · see citing works
Gong, T., Ren, Y., Wu, J. Y., Jiang, Y., Hu, W., & You, J. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.01.007 · Cited by 84 · see citing works
Reisenzein, R., & Weber, H. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.007 · Cited by 81 · see citing works
The role of suppression in resolving interference: Evidence for an age-related deficit.
Healey, M. K., Hasher, L., & Campbell, K. L. (2013) · Psychology and Aging · doi:10.1037/a0033003 · Cited by 82 · see citing works
ANOVA and the variance homogeneity assumption: Exploring a better gatekeeper
Kim, Y. J., & Cribbie, R. A. (2017) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12103 · Cited by 80 · see citing works
Buckner, J. D., Lemke, A. W., Jeffries, E. R., & Shah, S. M. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.11.010 · Cited by 77 · see citing works
From Repeatability to Reproducibility and Corroboration
Feitelson, D. G. (2015) · ACM SIGOPS Operating Systems Review · doi:10.1145/2723872.2723875 · Cited by 75 · see citing works
Inferential statistics in Language Teaching Research : A review and ways forward
Lindstromberg, S. (2016) · Language Teaching Research · doi:10.1177/1362168816649979 · Cited by 75 · see citing works
Transparency of sustainability disclosures among luxury and mass-market fashion brands
Jestratijevic, I. M., Rudd, N. A., & Uanhoro, J. (2020) · Journal of Global Fashion Marketing · doi:10.1080/20932685.2019.1708774 · Cited by 79 · see citing works
Fitts, D. A. (2011) · Europe PMC (PubMed Central) · Cited by 72 · see citing works
Bravo, A. J., Pilatti, A., Pearson, M. R., Mezquita, L., Ibáñez, M. I., & Ortet, G. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.08.028 · Cited by 73 · see citing works
Developmental trends in sleep during adolescents' transition to young adulthood
Park, H., Chiang, J. J., Irwin, M. R., Bower, J. E., McCreath, H. E., & Fuligni, A. J. (2019) · Sleep Medicine · doi:10.1016/j.sleep.2019.04.007 · Cited by 72 · see citing works
Briere, J., Runtz, M., Eadie, E., Bigras, N., & Godbout, N. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.02.036 · Cited by 71 · see citing works
Local Influence and Robust Procedures for Mediation Analysis
Zu, J., & Yuan, K. (2010) · Multivariate Behavioral Research · doi:10.1080/00273170903504695 · Cited by 70 · see citing works
Bravo, A. J., Pearson, M. R., & Henson, J. M. (2016) · Substance Use & Misuse · doi:10.1080/10826084.2016.1214151 · Cited by 70 · see citing works
Pruebas de bondad de ajuste en distribuciones simétricas, ¿qué estadístico utilizar?
Pedrosa, I., Juarros‐Basterretxea, J., Robles-Fernández, A., Basteiro, J., & Garcı́a-Cueto, E. (2014) · Universitas Psychologica · doi:10.11144/javeriana.upsy14-1.pbad · Cited by 69 · see citing works
Direct Evidence for the Role of Inhibition in Resolving Interference in Memory
Healey, M. K., Campbell, K. L., Hasher, L., & Ossher, L. (2010) · Psychological Science · doi:10.1177/0956797610382120 · Cited by 68 · see citing works
Witness memory and alcohol: The effects of state-dependent recall.
Compo, N. S., Carol, R. N., Evans, J. R., Pimentel, P. S., Holness, H. K., Nichols‐Lopez, K., Rose, S., & Furton, K. G. (2016) · Law and Human Behavior · doi:10.1037/lhb0000224 · Cited by 67 · see citing works
Kira, I. A., Smith, I. E., Lewandowski, L., & Templin, T. (2010) · Journal of the American Psychiatric Nurses Association · doi:10.1177/1078390310384401 · Cited by 67 · see citing works
The semantic basis of taste-shape associations
Velasco, C., Woods, A. T., Marks, L. E., Cheok, A. D., & Spence, C. J. (2016) · PeerJ · doi:10.7717/peerj.1644 · Cited by 67 · see citing works
Auditory deep sleep stimulation in older adults at home: a randomized crossover trial
Lustenberger, C., Ferster, M. L., Huwiler, S., Brogli, L., Werth, E., Huber, R., & Karlen, W. (2022) · Communications Medicine · doi:10.1038/s43856-022-00096-6 · Cited by 67 · see citing works
Bigsby, E., & Hovick, S. R. A. (2017) · Health Communication · doi:10.1080/10410236.2016.1266575 · Cited by 66 · see citing works
Bravo, A. J., Prince, M. A., Pearson, M. R., & The Marijuana Outcomes Study Team (2017) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2017.78.203 · Cited by 66 · see citing works
CONSTRUCCIÓN DE INSTRUMENTOS DE MEDIDA PARA LA EVALUACIÓN UNIVERSITARIA
Muñiz, J., & Fonseca‐Pedrero, E. (2008) · Revista de Investigación en Educación · Cited by 65 · see citing works
Wilhelm, K., VILES, H. A., & Burke, Ó. (2015) · Earth Surface Processes and Landforms · doi:10.1002/esp.3882 · Cited by 62 · see citing works
Päuler-Kuppinger, L., & Jucks, R. (2017) · Active Learning in Higher Education · doi:10.1177/1469787417693507 · Cited by 62 · see citing works
Ozer, S., & Bertelsen, P. (2018) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12484 · Cited by 62 · see citing works
Effects of the Lee Silverman Voice Treatment (LSVT®LOUD) on Hypomimia in Parkinson's Disease
Dumer, A. I., Oster, H., McCabe, D. L., Rabin, L. A., Spielman, J. L., Ramig, L. O., & Borod, J. C. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000046 · Cited by 61 · see citing works
Subjective Well-Being for Children in a Rural Community
Newland, L. A., Giger, J. T., Lawler, M. J., Carr, E. R., Dykstra, E. A., & Roh, S. (2014) · Journal of Social Service Research · doi:10.1080/01488376.2014.917450 · Cited by 61 · see citing works
Hattenschwiler, N., Sterchi, Y., Mendes, M., & Schwaninger, A. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.05.003 · Cited by 54 · see citing works
Chen, Y., Zhu, J., & Zhang, W. (2021) · Journal of Adolescence · doi:10.1016/j.adolescence.2021.03.003 · Cited by 63 · see citing works
Pushing forward in embodied cognition: may we mouse the mathematical mind?
Fischer, M. H., & Hartmann, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01315 · Cited by 60 · see citing works
- Authors
- Erceg-Hurn, D. M., & Mirosevich, V. M.
- Affiliations
- Government of Western Australia (AU)
- ORCID
- Erceg-Hurn, David M.
- Venue
- American Psychologist
- Published
- 2008
- Volume
- 63
- Issue
- 7
- Pages
- 591-601
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2102493402
- Cited by
- 959
- References
- 76
- Citations by year
- 2026: 38 · 2025: 59 · 2024: 55 · 2023: 54 · 2022: 81 · 2021: 54 · 2020: 94 · 2019: 77 · 2018: 61 · 2017: 66 · 2016: 73 · 2015: 59 · 2014: 45 · 2013: 36 · 2012: 41
- FWCI
- 20.78
- Type
- journal article
- Language
- en
- Open access
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- UWA Profiles and Research Repository (UWA) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- robust statistics, rank tests, nonparametric tests, normality, homoscedasticity, statistical power, significance testing
- MeSH terms
- Data Interpretation, Statistical, Humans, Research, Software, Statistics, Nonparametric
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review