The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Robust statistical methods: A primer for clinical psychology and experimental psychopathology researchers
Open accessAbstract
This paper reviews and offers tutorials on robust statistical methods relevant to clinical and experimental psychopathology researchers. We review the assumptions of one of the most commonly applied models in this journal (the general linear model, GLM) and the effects of violating them. We then present evidence that psychological data are more likely than not to violate these assumptions. Next, we overview some methods for correcting for violations of model assumptions. The final part of the paper presents 8 tutorials of robust statistical methods using R that cover a range of variants of the GLM (t-tests, ANOVA, multiple regression, multilevel models, latent growth models). We conclude with recommendations that set the expectations for what methods researchers submitting to the journal should apply and what they should report.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Confirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614
Hao (2015) · doi:10.1002/14651858 · Cited by 11,321
Development and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099
BIRMAHER, B., BRENT, D. A., CHIAPPETTA, L., BRIDGE, J., MONGA, S., & BAUGHER, M. (1999) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199910000-00011 · Cited by 2,252
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,123
Introduction to Robust Estimation and Hypothesis Testing
(2012) · Elsevier eBooks · doi:10.1016/c2010-0-67044-1 · Cited by 2,055
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972) · Review of Educational Research · doi:10.3102/00346543042003237 · Cited by 1,826 · cited 1×
“05 level, and consequently power decreases (Glass et al., 1972).”
The Importance of the Normality Assumption in Large Public Health Data Sets
Lumley, T., Diehr, P., Emerson, S., & Chen, L. (2002) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.23.100901.140546 · Cited by 1,803
VISUAL IMAGERY DIFFERENCES IN THE RECALL OF PICTURES
MARKS, D. F. (1973) · British Journal of Psychology · doi:10.1111/j.2044-8295.1973.tb01322.x · Cited by 1,778
High Breakdown-Point and High Efficiency Robust Estimates for Regression
Yohai, V. J. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350366 · Cited by 1,644
The unicorn, the normal curve, and other improbable creatures.
Micceri, T. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.1.156 · Cited by 1,485
Hayes, A. F., & Cai, L. (2007) · Behavior Research Methods · doi:10.3758/bf03192961 · Cited by 1,432
An Introduction to the Bootstrap.
Kimber, A., Efron, B., & Tibshirani, R. J. (1994) · The Statistician · doi:10.2307/2348146 · Cited by 1,245
Discovering Statistics Using IBM SPSS Statistics: And Sex and Drugs and Rock “N” Roll
(2014) · Pflege · doi:10.1024/1012-5302/a000397 · Cited by 1,224
Multiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,095
Psychological therapies for people with borderline personality disorder.
Stoffers-Winterling, J. M., Völlm, B. A., Rücker, G., Timmer, A., Huband, N., & Lieb, K. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005652.pub2 · Cited by 895
robustlmm: An R Package for Robust Estimation of Linear Mixed-Effects Models
Koller, M. (2016) · Journal of Statistical Software · doi:10.18637/jss.v075.i06 · Cited by 713
Analysis of cost data in randomized trials: an application of the non-parametric bootstrap
Barber, J. A., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001215)19:23<3219::aid-sim623>3.0.co;2-p · Cited by 690
(2001) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(00)00085-1 · Cited by 590
Introduction to Robust Estimation and Hypothesis Testing
Horn, P. S. (1998) · Technometrics · doi:10.1080/00401706.1998.10485491 · Cited by 507
The two-sample trimmed t for unequal population variances
YUEN, K. K. (1974) · Biometrika · doi:10.1093/biomet/61.1.165 · Cited by 486
Fundamentals of Modern Statistical Methods: Substantially Improving Power and Accuracy
Wilcox, R. R. (2010) · doi:10.1007/978-1-4419-5525-8 · Cited by 404
Self-citationThe Social Functioning Questionnaire: A Rapid and Robust Measure of Perceived Functioning
Tyrer, P., Nur, U., Crawford, M., Karlsen, S., MacLean, C., Rao, B., & Johnson, T. (2005) · International Journal of Social Psychiatry · doi:10.1177/0020764005057391 · Cited by 347
Test of Self-Conscious Affect (TOSCA)
Broerman, R. (2018) · Encyclopedia of Personality and Individual Differences · doi:10.1007/978-3-319-28099-8_954-1 · Cited by 307
How many discoveries have been lost by ignoring modern statistical methods?
Wilcox, R. R. (1998) · American Psychologist · doi:10.1037//0003-066x.53.3.300 · Cited by 298
Self-citationSharpening Wald-type inference in robust regression for small samples
Koller, M., & Stahel, W. A. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2011.02.014 · Cited by 286
Discovering statistics using IBM SPSS Statistics: and sex and drugs and rock ‘n’ roll, 4th edition
Field, A. P. (2013) · Figshare · Cited by 224
Self-citationField, A. P., & Lawson, J. (2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(03)00034-2 · Cited by 222
Self-citationPsychological therapies for people with borderline personality disorder
Binks, C., Fenton, M., McCarthy, L., Lee, T., Adams, C. E., & Duggan, C. F. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005652 · Cited by 209
Bootstrap confidence intervals: Good or bad?
Efron, B. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.104.2.293 · Cited by 162
Zimmerman, M. A., Chelminski, I., & Posternak, M. A. (2004) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000138226.22761.39 · Cited by 141
Donaldson, T. S. (1968) · Journal of the American Statistical Association · doi:10.2307/2284037 · Cited by 140
Obustness of Some Procedures for the Two-Sample Location Problem
Pratt, J. W. (1964) · Journal of the American Statistical Association · doi:10.1080/01621459.1964.10480721 · Cited by 113
Donaldson, T. S. (1968) · Journal of the American Statistical Association · doi:10.1080/01621459.1968.11009285 · Cited by 86
Some Myths and Legends in Quantitative Psychology
Grayson, D. (2004) · Understanding Statistics · doi:10.1207/s15328031us0302_3 · Cited by 70
Kelly, V. L., Barker, H., Field, A. P., Wilson, C., & Reynolds, S. A. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.10.002 · Cited by 48
Self-citationPicardi, A., Battisti, F., de Girolamo, G., Morosini, P., Norcio, B., Bracco, R., & Biondi, M. (2007) · Journal of Affective Disorders · doi:10.1016/j.jad.2007.09.010 · Cited by 41
Analysis of the short form‐36 (SF‐36): the beta‐binomial distribution approach
Aróstegui, I., Núñez‐Antón, V., & Quintana, J. M. (2006) · Statistics in Medicine · doi:10.1002/sim.2612 · Cited by 38
Shared and Unique Cognitive Factors in Social Anxiety
Field, A. P., & Cartwright‐Hatton, S. (2008) · International Journal of Cognitive Therapy · doi:10.1521/ijct.2008.1.3.206 · Cited by 31
Self-citationGeneralized Linear Model Analyses for Treatment Group Equality when Data are Non-Normal
Kesleman, H. J., Othman, A. R., & Wilcox, R. R. (2016) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1462075380 · Cited by 22
Self-citationWilcox, R. R., Carlson, M. E., Azen, S., & Clark, F. A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.003 · Cited by 17
Self-citationEconomic evaluation in long‐term clinical trials
Hlatky, M. A., Boothroyd, D. B., & Johnstone, I. M. (2002) · Statistics in Medicine · doi:10.1002/sim.1292 · Cited by 16
Estimating the accuracy of psychological scales using longitudinal data
Rutter, C. M. (2003) · Biostatistics · doi:10.1093/biostatistics/4.1.97 · Cited by 14
Cited by
Robust statistical methods in R using the WRS2 package
Mair, P., & Wilcox, R. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01246-w · Cited by 1,082
Self-citationLonergan, A. R., Bussey, K., Mond, J., Brown, O., Griffiths, S., Murray, S. B., & Mitchison, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.12.001 · Cited by 209
Murphy, J., Brewer, R., Hobson, H., Catmur, C., & Bird, G. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.05.010 · Cited by 180
Karin, E., Dear, B. F., Heller, G. Z., Gandy, M., & Titov, N. (2018) · JMIR Mental Health · doi:10.2196/10200 · Cited by 69
“Sorry, it was my fault”: Repairing trust in human-robot interactions
Zhang, X., Lee, S. K., Kim, W., & Hahn, S. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103031 · Cited by 62
Metadata
- Authors
- Field, A. P., & Wilcox, R. R.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 98
- Pages
- 19-38
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W2617046746
- Cited by
- 418
- References
- 48
- FWCI
- 22.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.