The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method
Abstract
Experimental studies in biomedical research frequently pose analytical problems related to small sample size. In such studies, there are conflicting findings regarding the choice of parametric and nonparametric analysis, especially with non‐normal data. In such instances, some methodologists questioned the validity of parametric tests and suggested nonparametric tests. In contrast, other methodologists found nonparametric tests to be too conservative and less powerful and thus preferred using parametric tests. Some researchers have recommended using a bootstrap test; however, this method also has small sample size limitation. We used a pooled method in nonparametric bootstrap test that may overcome the problem related with small samples in hypothesis testing. The present study compared nonparametric bootstrap test with pooled resampling method corresponding to parametric, nonparametric, and permutation tests through extensive simulations under various conditions and using real data examples. The nonparametric pooled bootstrap t‐test provided equal or greater power for comparing two means as compared with unpaired t‐test, Welch t‐test, Wilcoxon rank sum test, and permutation test while maintaining type I error probability for any conditions except for Cauchy and extreme variable lognormal distributions. In such cases, we suggest using an exact Wilcoxon rank sum test. Nonparametric bootstrap paired t‐test also provided better performance than other alternatives. Nonparametric bootstrap test provided benefit over exact Kruskal–Wallis test. We suggest using nonparametric bootstrap test with pooled resampling method for comparing paired or unpaired means and for validating the one way analysis of variance test results for non‐normal data in small sample size studies. Copyright © 2017 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Rank transformations as a bridge between parametric and nonparametric statistics
Conover, W. J., & Iman, R. L. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479327 · Cited by 3,922
Siegel, S. (1957) · The American Statistician · doi:10.1080/00031305.1957.10501091 · Cited by 3,903
The Importance of the Normality Assumption in Large Public Health Data Sets
Lumley, T., Diehr, P., Emerson, S., & Chen, L. (2002) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.23.100901.140546 · Cited by 1,803
The multivariate skew-normal distribution
Azzalini, A. (1996) · Biometrika · doi:10.1093/biomet/83.4.715 · Cited by 1,650
Using the Student's t-test with extremely small sample sizes
de Winter, J. C. F. (2013) · University of Massachusetts Amherst · doi:10.7275/e4r6-dj05 · Cited by 992
Permutation Methods: A Basis for Exact Inference
Ernst, M. D. (2004) · Statistical Science · doi:10.1214/088342304000000396 · Cited by 802
A comparison of statistical significance tests for information retrieval evaluation
Smucker, M. D., Allan, J., & Carterette, B. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321528 · Cited by 718
Phipson, B., & Smyth, G. K. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1585 · Cited by 712
The Skew-Normal and Related Families
Azzalini, A., & Capitanio, A. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139248891 · Cited by 710
Analysis of cost data in randomized trials: an application of the non-parametric bootstrap
Barber, J. A., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001215)19:23<3219::aid-sim623>3.0.co;2-p · Cited by 690
Statistical guidelines for contributors to medical journals.
Altman, D. G., Gore, S. M., Gardner, M. J., & Pocock, S. J. (1983) · BMJ · doi:10.1136/bmj.286.6376.1489 · Cited by 661
Introduction to Biostatistics.
North, P. M., Sokal, R. R., & Rohlf, F. J. (1988) · The Statistician · doi:10.2307/2348179 · Cited by 646
Carroll, K. M., Ball, S. A., Nich, C., Martino, S., Frankforter, T. L., Farentinos, C., Kunkel, L. E., Mikulich-Gilbertson, S. K., Morgenstern, J., Obert, J. L., et al. (2006) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.08.002 · Cited by 474
MUNDRY, R., & FISCHER, J. (1998) · Animal Behaviour · doi:10.1006/anbe.1998.0756 · Cited by 425
Why Permutation Tests are Superior to t and F Tests in Biomedical Research
Ludbrook, J., & Dudley, H. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480551 · Cited by 342
Why Permutation Tests Are Superior to t and F Tests in Biomedical Research
Ludbrook, J., & Dudley, H. (1998) · The American Statistician · doi:10.2307/2685470 · Cited by 281
Increasing Physicians’ Awareness of the Impact of Statistics on Research Outcomes
Bridge, P. D., & Sawilowsky, S. S. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00168-1 · Cited by 267
Using randomization techniques to analyse behavioural data
ADAMS, D. C., & ANTHONY, C. D. (1996) · Animal Behaviour · doi:10.1006/anbe.1996.0077 · Cited by 244
How do bootstrap and permutation tests work?
Janssen, A., & Pauls, T. (2003) · The Annals of Statistics · doi:10.1214/aos/1056562462 · Cited by 174
Pros and cons of permutation tests in clinical trials
Berger, V. W. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000530)19:10<1319::aid-sim490>3.0.co;2-0 · Cited by 170
Asymptotic Permutation Tests in General Factorial Designs
Pauly, M., Brunner, E., & Konietschke, F. (2014) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12073 · Cited by 134
Methods for Comparison of Cost Data
Zhou, X., Melfi, C. A., & Hui, S. L. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00063 · Cited by 129
Bootstrapping and permuting paired t-test type statistics
Konietschke, F., & Pauly, M. (2013) · Statistics and Computing · doi:10.1007/s11222-012-9370-4 · Cited by 113
Zimmerman, D. W., & Zumbo, B. D. (1992) · Perceptual and Motor Skills · doi:10.2466/pms.1992.74.3.835 · Cited by 51
Comparing two small samples with an unstable, treatment-independent baseline
Janušonis, S. (2009) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.01.017 · Cited by 49
Power of the independent samples t test under a prevalent psychometric measure distribution.
Sawilowsky, S. S., & Hillman, S. B. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.60.2.240 · Cited by 40
Exact level and power of permutation, bootstrap, and asymptotic tests of trend
Corcoran, C. D., & Mehta, C. R. (2002) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1020254880 · Cited by 25
Cited by
Young, C. B., Winer, J. R., Younes, K., Cody, K. A., Betthauser, T. J., Johnson, S. C., Schultz, A., Sperling, R. A., Greicius, M. D., Cobos, I., et al. (2022) · JAMA Neurology · doi:10.1001/jamaneurol.2022.0676 · Cited by 79
Palumbo, A., Aluru, V., Battaglia, J., Geller, D., Turry, A., Ross, M., Cristian, A., Balagula, C., Ogedegbe, G., Khatri, L., et al. (2022) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001938 · Cited by 46
Kwon, J., Kim, M., Hwang, W., Jo, A., Hwang, G.-H., Jung, M., Kim, U. G., Cui, G., Kim, H., Eom, J.-H., et al. (2023) · Genome biology · doi:10.1186/s13059-022-02842-4 · Cited by 24
Metadata
- Authors
- Dwivedi, A. K., Mallawaarachchi, I., & Alvarado, L. A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2017-03-09
- Volume
- 36
- Issue
- 14
- Pages
- 2187-2205
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2592359670
- Cited by
- 334
- References
- 30
- FWCI
- 8.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.