Bootstrap tests: how many bootstraps?
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In practice, bootstrap tests must use a finite number of bootstrap samples. This means that the outcome of the test will depend on the sequence of random numbers used to generate the bootstrap samples, and it necessarily results in some loss of power. We examine the extent of this power loss and propose a simple pretest procedure for choosing the number of bootstrap samples so as to minimize experimental randomness. Simulation experiments suggest that this procedure will work very well in practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bootstrap Methods and their Application
Davison, A. C., & Hinkley, D. V. (1997) · doi:10.1017/cbo9780511802843 · Cited by 7,350
Bootstrap Methods and Their Application
Loughin, T. M., Davison, A. C., & Hinkley, D. V. (1999) · Journal of the American Statistical Association · doi:10.2307/2669707 · Cited by 5,418
The Bootstrap and Edgeworth Expansion.
Beran, R., & Hall, P. (1993) · Journal of the American Statistical Association · doi:10.2307/2290736 · Cited by 1,886
A Simplified Monte Carlo Significance Test Procedure
Hope, A. C. A. (1968) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1968.tb00759.x · Cited by 1,073
Modified Randomization Tests for Nonparametric Hypotheses
Dwass, M. (1957) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177707045 · Cited by 737
Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators
Hall, P., & Horowitz, J. L. (1996) · Econometrica · doi:10.2307/2171849 · Cited by 468
Prepivoting Test Statistics: A Bootstrap View of Asymptotic Refinements
Beran, R. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478649 · Cited by 466
A Three-step Method for Choosing the Number of Bootstrap Repetitions
Andrews, D. W. K., & Buchinsky, M. (2000) · Econometrica · doi:10.1111/1468-0262.00092 · Cited by 306
Bootstrapping time series models
Hongyi Li, G. S., & Maddala (1996) · Econometric Reviews · doi:10.1080/07474939608800344 · Cited by 276
THE SIZE DISTORTION OF BOOTSTRAP TESTS
Davidson, R., & MacKinnon, J. G. (1999) · Econometric Theory · doi:10.1017/s0266466699153040 · Cited by 206
Self-citationBarnard's Monte Carlo Tests: How Many Simulations?
Marriott, F. H. C. (1979) · Applied Statistics · doi:10.2307/2346816 · Cited by 172
Finite Sample Properties and Asymptotic Efficiency of Monte Carlo Tests
Jockel, K.-H. (1986) · The Annals of Statistics · doi:10.1214/aos/1176349860 · Cited by 158
The Effect of Simulation Order on Level Accuracy and Power of Monte Carlo Tests
Hall, P., & Titterington, D. M. (1989) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1989.tb01440.x · Cited by 117
Cited by
How Many Bootstrap Replicates Are Necessary?
Pattengale, N. D., Alipour, M., Bininda-Emonds, O. R. P., Moret, B. M. E., & Stamatakis, A. (2010) · Journal of Computational Biology · doi:10.1089/cmb.2009.0179 · Cited by 958
Spreng, R. N., Sepulcre, J., Turner, G. R., Stevens, W. D., & Schacter, D. L. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00281 · Cited by 668
Entrepreneurial Orientation and Growth of SMEs: A Causal Model
Moreno, A. M., & Casillas, J. C. (2008) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2008.00238.x · Cited by 586
Bacq, S., & Alt, E. (2018) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2018.01.004 · Cited by 467
Promises, Threats and Fairness
Ellingsen, T., & Johannesson, M. (2004) · The Economic Journal · doi:10.1111/j.1468-0297.2004.00214.x · Cited by 426
Metadata
- Authors
- Davidson, R., & MacKinnon, J. G.
- Venue
- Econometric Reviews
- Publisher
- Informa UK Limited
- Published
- 2000-01
- Volume
- 19
- Issue
- 1
- Pages
- 55-68
- ISSN
- 0747-4938 (ISSN-L)
- 1532-4168
- OpenAlex
- W2122030147
- Cited by
- 460
- References
- 13
- FWCI
- 6.75
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.