The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs with the R Package MANOVA.RM
Open accessAbstract
Nonparametric statistical inference methods for a modern and robust analysis of longitudinal and multivariate data in factorial experiments are essential for research.While existing approaches that rely on specific distributional assumptions of the data (multivariate normality and/or equal covariance matrices) are implemented in statistical software packages, there is a need for user-friendly software that can be used for the analysis of data that do not fulfill the aforementioned assumptions and provide accurate p value and confidence interval estimates.Therefore, newly developed nonparametric statistical methods based on bootstrap-and permutation-approaches, which neither assume multivariate normality nor specific covariance matrices, have been implemented in the freely available R package MANOVA.RM.The package is equipped with a graphical user interface for plausible applications in academia and other educational purpose.Several motivating examples illustrate the application of the methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This analysis does not rely on assumptions of multivariate normality or specific covariance structures in the data, making it suitable even for data with non‐normal error terms and/or heteroscedastic variances [58, 59].”
From Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact (2026) · cites this paper as [58]
Citations
Cites
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 14,265
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828 · cited 2×
“Focusing on metric data and mean-based procedures, MANOVA and RM models are typically inferred by means of “classical” procedures such as Wilks’ Lambda, Lawley-Hotelling, Roy’s largest root (Davis, 2002; Johnson and Wichern, 2007; Anderson, 2001) or (generalized) linear mixed models with generalized estimating equatio…”
MethodApplied Multivariate Statistical Analysis
Härdle, W. K., & Simar, L. (2015) · Springer eBooks · doi:10.1007/978-3-662-45171-7 · Cited by 1,653
Applied Multivariate Statistical Analysis
Dunn, C. L., Johnson, R. A., & Wichern, D. W. (1989) · Technometrics · doi:10.2307/1268834 · Cited by 1,624
Noguchi, K., Gel, Y. R., Brunner, E., & Konietschke, F. (2012) · Journal of Statistical Software · doi:10.18637/jss.v050.i12 · Cited by 1,146 · cited 2×
“…rank-based methods for null hypotheses formulated in distribution functions are implemented within the packages npmv for oneand two-way MANOVA (Burchett et al., 2017) and nparLD for several repeated measures designs The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 (Noguchi et al., 2012).”
BackgroundMethodSelf-citationNonparametric analysis of longitudinal data in factorial experiments
Brunner, E., Domhof, S., & Langer, F. (2002) · Cited by 635
Nonparametric Analysis of Longitudinal Data in Factorial Experiments
Ghosh, S. (2003) · Technometrics · doi:10.1198/tech.2003.s161 · Cited by 585 · cited 1×
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodBox-Type Approximations in Nonparametric Factorial Designs
Brunner, E., Dette, H., & Munk, A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473671 · Cited by 272 · cited 2×
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodExact and asymptotically robust permutation tests
Chung, E., & Romano, J. P. (2013) · The Annals of Statistics · doi:10.1214/13-aos1090 · Cited by 239 · cited 2×
“, 2018) and ffmanova (Øyvind Langsrud and Mevik, 2019) contain interesting permutation and rotation tests, which, however, require certain invariances resulting in model restrictions (see, e.g., the discussion in Huang et al., 2006; Chung and Romano, 2013) .”
BackgroundNonparametric Inference for Multivariate Data: The R Package npmv
Burchett, W., Ellis, A. R., Harrar, S. W., & Bathke, A. C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i04 · Cited by 203 · cited 5×
“, 2006; Chung and Romano, 2013) . Most of these procedures, however, rely on specific distributional assumptions (such as multivariate normality) and/or specific covariance or correlation structures (e.g., homogeneity between groups or, for RM, compound symmetry; possibly implying equal correlation between measurement…”
BackgroundMethodInfluential
Cited by
Sorted by citations
Items 101–133 of 133
Composing with acoustic niches: A laboratory soundscape evaluation of sound installation reactivity
Fraisse, V., Schütz, N., Vincent, C., Wanderley, M. M., Guastavino, C., & Misdariis, N. (2026) · npj Acoustics · doi:10.1038/s44384-026-00066-5 · Cited by 1
Musical expertise shapes visual-melodic memory integration
Hoffmann, M., Schmidt, A., & Ploner, C. J. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.973164 · Cited by 2
Trelles, M. P., Mahjani, B., Wilkinson, E., Buonagura, N., Donnelly, L., Foss‐Feig, J. H., Halpern, D. B., McKay, M. M., Siper, P. M., Buxbaum, J. D., et al. (2025) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-024-10001-9 · Cited by 1
Romances teatrales entre Mira de Amescua, Calderón y Lope, ritmo, asonancia y cuestiones de autoría
Kroll, S., & Sanz-Lázaro, F. (2022) · Revista de Humanidades Digitales · doi:10.5944/rhd.vol.7.2022.31620 · Cited by 1
Findor, A., Hruška, M., Hlatky, R., Hrustič, T., & Bošeľová, Z. (2021) · doi:10.31235/osf.io/kwdtb · Cited by 1
Shonka, S., & Hylin, M. J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.24.655898 · Cited by 1
Gruner, N. G., Cullen, J. M., Crosby, J. M., DeCross, S. N., Mathes, B., Garner, L., Gironda, C., Hu, Y., Krompinger, J. W., Elias, J. A., et al. (2024) · Journal of Cognitive Psychotherapy · doi:10.1891/jcp-2022-0033
Çelikbıçak, M. B., & Aktaş, S. (2020) · Hacettepe Journal of Mathematics and Statistics · doi:10.15672/hujms.743041
Multifactor Modeling and Analysis of Repeated Observations of Biological Objects
Belov, A. G., Polienko, A. E., & Belova, O. A. (2021) · Moscow University Computational Mathematics and Cybernetics · doi:10.3103/s0278641921020011
Brand Engagement in the Light of Post Content Type on the Facebook Platform in the Selected Industry
Nastišin, Ľ., Fedorko, R., Bačík, R., & Rigelský, M. (2021) · GATR Journal of Management and Marketing Review · doi:10.35609/jmmr.2021.6.1(4
Humanization and policy support: A replication-extension on group-composition framingPreprint
Findor, A., Hruška, M., Hlatky, R., Dvorská, A., Hrustič, T., Bošeľová, Z., & Buchel, O. (2021) · doi:10.31234/osf.io/3avwh
Slovenian Version of the Deese–Roediger–McDermott Paradigm: A Normative and Exploratory Study
Černe, J., & Kordeš, U. (2023) · Psihološka obzorja / Horizons of Psychology · doi:10.20419/2023.32.572
“…distributions differed from normal, some RTs were unusually long, etc.), we decided to use robust statistical methods from the R packages MANOVA.RM (Friedrich et al., 2019) and WRS2 (Mair & Wilcox, 2020), developed to maintain the power in the presence of outliers and non-normal distributions 4 .”
MethodPreliminary Insights into Enhancing Human-Robot Teamwork
Momose, K., Weekes, T. R., & Eskridge, T. C. (2023) · Florida Conference on Recent Advances in Robotics (FCRAR) · doi:10.5038/yexl3996
Bootstrap und Permutationsverfahren für biometrische Inferenz
Friedrich, S., Konietschke, F., & Pauly, M. (2023) · Springer eBooks · doi:10.1007/978-3-662-63496-7_16-1
Self-citationWorry postponement from the metacognitive perspective: A randomized waitlist-controlled trial
Krzikalla, C., Buhlmann, U., Schug, J., Kopei, I., Gerlach, A. L., Doebler, P., Nexhmedin Morina, B., & Andor, T. (2024) · Clinical Psychology in Europe · doi:10.32872/cpe.12741 · Cited by 2
“Due to violations of homogeneity of variance, we calculated a robust ANOVA using the R package MANOVA.RM (Friedrich et al., 2019) and post-hoc Welch’s t -tests for MCQ-NEG.”
MethodVisually induced involuntary arm, head, and torso movements
Martin, A., Bakshi, A., Ventura, J., Panic, A. S., & Lackner, J. R. (2024) · Experimental Brain Research · doi:10.1007/s00221-024-06913-9
“MANOVAs and ANOVAs were done using the MANOVA.RM package in RStudio (Friedrich et al. 2019).”
Nascimento, J., Santos, J. J., & Bittencourt, I. I. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00432-y · Cited by 2
Defacing biases visual quality assessments of structural MRIPreprint
Provins, C., Savary, É., Sanchez, T., Mullier, E., Barranco, J., Fischi-Gómez, E., Alemán‐Gómez, Y., Richiardi, J., Poldrack, R. A., Hagmann, P., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.11.617777
“This test was implemented with the multRM function of the MANOVA.RM package [39] in R.”
Kiefel, M., & Freidl, J. (2024) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-024-00671-5
Ortiz, H., Acal, C., Escabias, M., & Aguilera, A. M. (2025) · AIMS Mathematics · doi:10.3934/math.2025390
York, R. A., Lennon, A., Redmond, M. D., & Collins, B. M. (2025) · Forestry An International Journal of Forest Research · doi:10.1093/forestry/cpaf025
“To test for non-parallel trends in height and basal diameter growth between herbicide-treated and control gaps, repeated measures multivariate analysis of variance (MANOVA) was used with the MANOVA.RM package (Friedrich et al. 2019).”
Bhattacharya, S., Prinz, L. M., & Mathew, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93700-2_10
Schroeer, A., Corona–Strauss, F. I., & Strauß, D. J. (2025) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2025.3614891
“As most data were not normally distributed, we utilized the non-parametric repeated measures model by Friedrich et al. [33].”
von Haugwitz, L., Wascher, E., & Larra, M. F. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1150 · Cited by 1
“To account for the unbalanced group sizes, we conducted robust repeated-measures ANOVAs using the RM function from the MANOVA.RM R package ( Friedrich et al., 2019).”
Sela, O. W. B., Ofir, S., Pell, G. S., Roth, Y., Friedman, J., Muhana, A., Frenkel‐Toledo, S., & Soroker, N. (2026) · PLoS ONE · doi:10.1371/journal.pone.0343725
“Assessment of the effect of coil and stimulation side on the rMT was done by a non-parametric two-way repeated-measures ANOVA (two within-subject factors) implemented in ‘MANOVA.RM’ package [26].”
Morphometric Characterization of the Domestic Yak Skull (Bos grunniens Linnaeus, 1766)
Arı, H. H., Alpak, H., Kadyralieva, N., Begaliev, A., Djordjevic, M., & Gündemir, O. (2026) · Animals · doi:10.3390/ani16091320
Psychophysiological stress response to the Open TSST VR-Y in a youth sample: A feasibility study
Seel, S., von Dawans, B., & Domes, G. (2026) · Biological Psychology · doi:10.1016/j.biopsycho.2026.109303
Perkovich, C., Eichler, M., O’Neal, P. A., & Addesso, K. M. (2026) · Journal of Chemical Ecology · doi:10.1007/s10886-026-01743-1
“Phytochemical constituents were analyzed using a repeated measure multivariate analysis of variance (rmMANOVA) from the MANOVA.RM package (Friedrich et al. 2019) to account for multiple dependent variables.”
Scott, M. T. W., Limon, P. N., Mohammadjavadi, M., Kop, B. R., Chen, N.-F., Feredoes, E. A., Vildavski, V. Y., Popelka, G. R., Norcia, A. M., Pauly, K. B., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.30.741804
Hucke, C. I., Gallus, V., Butter, K., Reiser, J. E., Ohlmeyer, M., & van Thriel, C. (2026) · Building and Environment · doi:10.1016/j.buildenv.2026.115297
Regional Heterogeneity of Sensorimotor BOLD Lateralization During Unilateral Hand MovementPreprint
Xu, C., Zhou, H., Wang, Q., Li, Z., & Wang, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-11254024/v1
Metadata
- Authors
- Friedrich, S., Konietschke, F., & Pauly, M.
- Affiliations
- TU Dortmund University (DE)
- Venue
- The R Journal
- Publisher
- The R Foundation
- Published
- 2019
- Volume
- 11
- Issue
- 2
- Pages
- 380
- ISSN
- 2073-4859 (ISSN-L)
- OpenAlex
- W2998668315
- Cited by
- 131
- References
- 42
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 19 · 2023: 31 · 2022: 17 · 2021: 19 · 2020: 13
- FWCI
- 5.58
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- The R Journal (publishedVersion, cc-by)
- Lincoln (University of Nebraska) (submittedVersion, cc-by)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, other-oa)
- OPUS (Augsburg University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (DFG‐PA 2409/3‐1)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- repeated measures designs, longitudinal data, bootstrapping, permutation tests, multivariate normality, covariance structure, R package, graphical user interface, confidence intervals, p-value estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
