Randomization Tests
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
A randomization test is a permutation test that is based on randomization (random assignment), where the test is carried out in the following way. A test statistic (such as a difference between means) is computed for the experimental data (measurements or observations). Then the data are repeatedly divided or rearranged in a manner consistent with what the random assignment procedure would have produced if the treatments had no differential effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“we know this counterfactual outcome in a randomized design if the null hypothesis is true: the Y score would just have been the same if another assignment was selected”
From Analyzing data from single-case alternating treatments designs. (2018) · cites this paper as Edgington & Onghena, 2007
Citations
Cites
Modified Randomization Tests for Nonparametric Hypotheses
Dwass, M. (1957) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177707045 · Cited by 737
Significance Tests Which May be Applied to Samples from Any Populations
Pitman, E. J. G. (1937) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2984124 · Cited by 729
PITMAN, E. J. G. (1938) · Biometrika · doi:10.1093/biomet/29.3-4.322 · Cited by 328
Pitman, E. J. G. (1937) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2983647 · Cited by 266
Randomization Analysis of Experimental Data: The Fisher Randomization Test
Basu, D. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477512 · Cited by 164
Statistical Inference from N= 1 Experiments
Edgington, E. S. (1967) · The Journal of Psychology · doi:10.1080/00223980.1967.10544864 · Cited by 104
Self-citationValidity of Randomization Tests for One-Subject Experiments
Edgington, E. S. (1980) · Journal of Educational Statistics · doi:10.2307/1164966 · Cited by 95
Self-citationRandomization Tests for a Multivariate Two-Sample Problem
Chung, J. H., & Fraser, D. A. S. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501472 · Cited by 77
Zerbe, G. O., & Walker, S. H. (1977) · Biometrics · doi:10.2307/2529463 · Cited by 49
Statistics and Single Case Analysis
Edgington, E. S. (1984) · Progress in behavior modification · doi:10.1016/b978-0-12-535616-9.50008-0 · Cited by 48
Self-citationA Practical Interactive Program for Randomization Tests of Location
Green, B. F. (1977) · The American Statistician · doi:10.1080/00031305.1977.10479192 · Cited by 46
Overcoming Obstacles to Single-Subject Experimentation
Edgington, E. S. (1980) · Journal of Educational Statistics · doi:10.2307/1164968 · Cited by 39
Self-citationTwo-Sample Randomization Tests for Space-Time Clustering
Klauber, M. R. (1971) · Biometrics · doi:10.2307/2528932 · Cited by 39
Obstacles in Using Randomization Tests in Single-Case Experimentation
Kazdin, A. E. (1980) · Journal of Educational Statistics · doi:10.3102/10769986005003253 · Cited by 29
Randomization tests in single-subject designs: Illustrative examples
Wampold, B. E., & Furlong, M. J. (1981) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf01350836 · Cited by 25
Some statistical issues in weather experimentation
Gabriel, K. R. (1979) · Communication in Statistics- Theory and Methods · doi:10.1080/03610927908827812 · Cited by 22
Response-Guided Experimentation
Edgington, E. S. (1983) · Contemporary Psychology · doi:10.1037/021569 · Cited by 21
Self-citationAnalyzing the results of a cloud-seeding experiment in tasmania
Miller, T., Shaw, D. E., Veitch, L., & Smith, E. J. (1979) · Communication in Statistics- Theory and Methods · doi:10.1080/03610927908827813 · Cited by 17
380: Space-Time Clustering Tests for More Than Two Samples
Klauber, M. R. (1975) · Biometrics · doi:10.2307/2529554 · Cited by 16
The Role of Permutation Groups in Randomization Tests
Edgington, E. S. (1983) · Journal of Educational Statistics · doi:10.3102/10769986008002121 · Cited by 4
Self-citation
Cited by
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
SPECIES ASSEMBLAGES AND INDICATOR SPECIES:THE NEED FOR A FLEXIBLE ASYMMETRICAL APPROACH
Dufrêne, M., & Legendre, P. (1997) · Ecological Monographs · doi:10.1890/0012-9615(1997)067[0345:saaist]2.0.co;2 · Cited by 7,431
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Lebreton, J.-D., Burnham, K. P., Clobert, J., & Anderson, D. R. (1992) · Ecological Monographs · doi:10.2307/2937171 · Cited by 4,517
Associations between species and groups of sites: indices and statistical inference
Cáceres, M. D., & Legendre, P. (2009) · Ecology · doi:10.1890/08-1823.1 · Cited by 4,002
Metadata
- Authors
- Edgington, E., Edgington, E., & Onghena, P.
- ORCID
- Onghena, Patrick
- Venue
- Encyclopedia of Statistical Sciences
- Publisher
- Chapman and Hall/CRC
- Published
- 2007-02-22
- Volume
- 57
- Issue
- 2
- Pages
- 1182-1183
- OpenAlex
- W2612575796
- Cited by
- 2,030
- References
- 20
- Citations by year
- 2026: 20 · 2025: 28 · 2024: 25 · 2023: 39 · 2022: 28 · 2021: 37 · 2020: 75 · 2019: 56 · 2018: 57 · 2017: 63 · 2016: 63 · 2015: 44 · 2014: 78 · 2013: 79 · 2012: 62
- Type
- reference entry
- Language
- en
- Open access
- closed
- Locations
- Encyclopedia of Statistical Sciences (publishedVersion)
- Wiley StatsRef: Statistics Reference Online (publishedVersion)
- International Encyclopedia of Statistical Science (publishedVersion)
- The Journal of Psychology (publishedVersion)
- Chapman & Hall/CRC eBooks (publishedVersion)
- PubMed (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Funders
- Killam Trusts
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- permutation tests, random assignment, test statistics, hypothesis testing, null hypothesis
- MeSH terms
- Humans, Random Allocation, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.