The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms
Open accessAbstract
In the paper we present some guidelines for the application of nonparametric statistical tests and post-hoc procedures devised to perform multiple comparisons of machine learning algorithms. We emphasize that it is necessary to distinguish between pairwise and multiple comparison tests. We show that the pairwise Wilcoxon test, when employed to multiple comparisons, will lead to overoptimistic conclusions. We carry out intensive normality examination employing ten different tests showing that the output of machine learning algorithms for regression problems does not satisfy normality requirements. We conduct experiments on nonparametric statistical tests and post-hoc procedures designed for multiple 1×N and N ×N comparisons with six different neural regression algorithms over 29 benchmark regression data sets. Our investigation proves the usefulness and strength of multiple comparison statistical procedures to analyse and select machine learning algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown
Lilliefors, H. W. (1967) · Journal of the American Statistical Association · doi:10.2307/2283970 · Cited by 4,530
Anderson, T. W., & Darling, D. A. (1954) · Journal of the American Statistical Association · doi:10.1080/01621459.1954.10501232 · Cited by 2,450
Shaffer, J. P. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.003021 · Cited by 1,960
A Suggestion for Using Powerful and Informative Tests of Normality
D'agostino, R. B., Belanger, A., & D'agostino, R. B. (1990) · The American Statistician · doi:10.2307/2684359 · Cited by 1,809
Approximations of the critical region of the fbietkan statistic
Iman, R. L., & Davenport, J. M. (1980) · Communications in Statistics - Theory and Methods · doi:10.1080/03610928008827904 · Cited by 1,125
Cited by
Carrasco, J., García, S., Rueda, M. M., Das, S., & Herrera, F. (2020) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2020.100665 · Cited by 513
Barbado, A., Corcho, Ó., & Benjamins, R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116100 · Cited by 77
“This serves for performing an hypothesis contrast based on the Wilcoxon signed-rank test [39], since it has been proved useful for comparing different ML model metrics results over several datasets for both classification [40] and regression tasks [41].”
Method
Metadata
- Authors
- Trawiński, B., Smętek, M., Telec, Z., & Lasota, T.
- Venue
- International Journal of Applied Mathematics and Computer Science
- Publisher
- University of Zielona Góra, Poland
- Published
- 2012-12-28
- Volume
- 22
- Issue
- 4
- Pages
- 867-881
- ISSN
- 1641-876X (ISSN-L)
- 2083-8492
- OpenAlex
- W2077654972
- Cited by
- 185
- References
- 8
- FWCI
- 11.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms. https://app.cochat.ai/papers/10.2478/v10006-012-0064-z
- The paper
- Trawiński, B., Smętek, M., Telec, Z., & Lasota, T. (2012). Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms. International Journal of Applied Mathematics and Computer Science. https://doi.org/10.2478/v10006-012-0064-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.