The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Permutation Methods: A Basis for Exact Inference
Open accessAbstract
The use of permutation methods for exact inference dates back to Fisher in 1935. Since then, the practicality of such methods has increased steadily with computing power. They can now easily be employed in many situations without concern for computing difficulties. We discuss the reasoning behind these methods and describe situations when they are exact and distribution-free. We illustrate their use in several examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language for Data Analysis and Graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,220
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Randomization, Bootstrap and Monte Carlo Methods in Biology
Manly, B. F. J. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315273075 · Cited by 4,194
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.2307/1268531 · Cited by 3,329
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Edgington, E. S. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2169 · Cited by 2,028
Distribution-Free Statistical Tests
Bell, C. B. (1970) · Technometrics · doi:10.1080/00401706.1970.10488744 · Cited by 1,695
Modified Randomization Tests for Nonparametric Hypotheses
Dwass, M. (1957) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177707045 · Cited by 737
Significance Tests Which May be Applied to Samples from Any Populations
Pitman, E. J. G. (1937) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2984124 · Cited by 729
PITMAN, E. J. G. (1938) · Biometrika · doi:10.1093/biomet/29.3-4.322 · Cited by 328
Cited by
Nonparametric statistical testing of EEG- and MEG-data
Maris, E., & Oostenveld, R. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.03.024 · Cited by 8,496
“The permutation and the randomization test have a different rationale (Ernst, 2004), but in practice they often involve the same calculations.”
BackgroundMethodPermutation inference for the general linear model
Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., & Nichols, T. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.060 · Cited by 3,563
Implementing a Class of Permutation Tests: The coin Package
Hothorn, T., Hornik, K., Wiel, M. A. V. D., & Zeileis, A. (2008) · Journal of Statistical Software · doi:10.18637/jss.v028.i08 · Cited by 1,492
Comparing network structures on three aspects: A permutation test.
van Borkulo, C. D., van Bork, R., Boschloo, L., Kossakowski, J. J., Tio, P., Schoevers, R. A., Borsboom, D., & Waldorp, L. J. (2023) · Psychological Methods · doi:10.1037/met0000476 · Cited by 1,465
Vallières, M., Freeman, C. R., Skamene, S. R., & El Naqa, I. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/14/5471 · Cited by 897
A Lego System for Conditional Inference
Hothorn, T., Hornik, K., van de Wiel, M. A., & Zeileis, A. (2006) · The American Statistician · doi:10.1198/000313006x118430 · Cited by 892
Phipson, B., & Smyth, G. K. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1585 · Cited by 712
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0912-z · Cited by 651
ROAST: rotation gene set tests for complex microarray experiments
Wu, D., Lim, E., Vaillant, F., Asselin-Labat, M.-L., Visvader, J. E., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq401 · Cited by 560
Econometric Methods for Program Evaluation
Abadie, A., & Cattaneo, M. D. (2018) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053402 · Cited by 431
The impact of a view from a window on thermal comfort, emotion, and cognitive performance
Ko, W. H., Schiavon, S., Zhang, H., Graham, L. T., Brager, G., Mauss, I., & Lin, Y.-W. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.106779 · Cited by 342
Dwivedi, A. K., Mallawaarachchi, I., & Alvarado, L. A. (2017) · Statistics in Medicine · doi:10.1002/sim.7263 · Cited by 334
Why We Should Not Be Indifferent to Specification Choices for Difference‐in‐Differences
Ryan, A. M., Burgess, J. F., & Dimick, J. B. (2015) · Health Services Research · doi:10.1111/1475-6773.12270 · Cited by 320
To test or not to test: Preliminary assessment of normality when comparing two independent samples
Rochon, J., Gondan, M., & Kieser, M. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-81 · Cited by 296
“If the assumptions are violated, T is compared with the wrong reference distribution, which may result in a deviation of the actual Type I error from the nominal significance level [12,13], in a loss of power relative to other tests developed for similar problems [14], or both.”
ResultHERMES: Towards an Integrated Toolbox to Characterize Functional and Effective Brain Connectivity
Niso, G., Bruña, R., Pereda, E., Gutiérrez, R., Bajo, R., Maestú, F., & del-Pozo, F. (2013) · Neuroinformatics · doi:10.1007/s12021-013-9186-1 · Cited by 281
Nonparametric statistical testing of coherence differences
Maris, E., Schoffelen, J.-M., & Fries, P. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.02.011 · Cited by 279
Summer drought alters carbon allocation to roots and root respiration in mountain grassland
Hasibeder, R., Fuchslueger, L., Richter, A., & Bahn, M. (2015) · New Phytologist · doi:10.1111/nph.13146 · Cited by 278
Residual-Based Shadings for Visualizing (Conditional) Independence
Zeileis, A., Meyer, D., & Hornik, K. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x237856 · Cited by 268
A Common Neural Mechanism for Preventing and Terminating the Allocation of Attention
Sawaki, R., Geng, J. J., & Luck, S. J. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.1864-12.2012 · Cited by 265
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramer, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2017) · 2017 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2017.29 · Cited by 171
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramèr, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2015) · arXiv · doi:10.48550/arxiv.1510.02377 · Cited by 171
Allefeld, C., Görgen, K., & Haynes, J.-D. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.07.040 · Cited by 157
van der Meer, A. L. H., & van der Weel, F. R. (. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00706 · Cited by 62
Sreekumar, V., Nielson, D. M., Smith, T. A., Dennis, S. J., & Sederberg, P. B. (2018) · Scientific Reports · doi:10.1038/s41598-018-32879-0 · Cited by 64
Analysis of single-case data: Randomisation tests for measures of effect size
Heyvaert, M., & Onghena, P. (2014) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.818564 · Cited by 64
The effect of health insurance on crime: Evidence from the Affordable Care Act Medicaid expansion
He, Q., & Barkowski, S. (2020) · Health Economics · doi:10.1002/hec.3977 · Cited by 62
How Attention Changes in Response to Incentives
Sawaki, R., Luck, S. J., & Raymond, J. E. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00847 · Cited by 57
Rokicki, S., Cohen, J., Fink, G., Salomon, J. A., & Landrum, M. B. (2018) · Medical Care · doi:10.1097/mlr.0000000000000830 · Cited by 53
Poncet, A., Courvoisier, D. S., Combescure, C., & Perneger, T. V. (2016) · Methodology · doi:10.1027/1614-2241/a000110 · Cited by 49
A citywide experiment testing the impact of geographically targeted, high-pay-off vaccine lotteries
Milkman, K. L., Gandhi, L., Ellis, S. F., Graci, H. N., Gromet, D. M., Mobarak, R. S., Buttenheim, A. M., Duckworth, A. L., Pope, D., Stanford, A., et al. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01437-0 · Cited by 44
Age-related effects in working memory recognition modulated by retroactive interference.
Solesio-Jofre, E., Lorenzo-Lopez, L., Gutierrez, R., Lopez-Frutos, J. M., Ruiz-Vargas, J. M., & Maestu, F. (2012) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/glr199 · Cited by 35
Altenburger, K., De, R., Frazier, K., Avteniev, N., & Hamilton, J. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14929 · Cited by 35
Vilhelmsen, K., Agyei, S. B., van der Weel, F. R. (., & van der Meer, A. L. H. (2019) · Psychophysiology · doi:10.1111/psyp.13281 · Cited by 16
Metadata
- Authors
- Ernst, M. D.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2004-11-01
- Volume
- 19
- Issue
- 4
- Pages
- 676-685
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2026593185
- Cited by
- 802
- References
- 18
- FWCI
- 2.95
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.