The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs with the R Package MANOVA.RM
Open accessAbstract
Nonparametric statistical inference methods for a modern and robust analysis of longitudinal and multivariate data in factorial experiments are essential for research.While existing approaches that rely on specific distributional assumptions of the data (multivariate normality and/or equal covariance matrices) are implemented in statistical software packages, there is a need for user-friendly software that can be used for the analysis of data that do not fulfill the aforementioned assumptions and provide accurate p value and confidence interval estimates.Therefore, newly developed nonparametric statistical methods based on bootstrap-and permutation-approaches, which neither assume multivariate normality nor specific covariance matrices, have been implemented in the freely available R package MANOVA.RM.The package is equipped with a graphical user interface for plausible applications in academia and other educational purpose.Several motivating examples illustrate the application of the methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This analysis does not rely on assumptions of multivariate normality or specific covariance structures in the data, making it suitable even for data with non‐normal error terms and/or heteroscedastic variances [58, 59].”
From Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact (2026) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 14,265
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828 · cited 2×
“Focusing on metric data and mean-based procedures, MANOVA and RM models are typically inferred by means of “classical” procedures such as Wilks’ Lambda, Lawley-Hotelling, Roy’s largest root (Davis, 2002; Johnson and Wichern, 2007; Anderson, 2001) or (generalized) linear mixed models with generalized estimating equatio…”
MethodApplied Multivariate Statistical Analysis
Härdle, W. K., & Simar, L. (2015) · Springer eBooks · doi:10.1007/978-3-662-45171-7 · Cited by 1,653
Applied Multivariate Statistical Analysis
Dunn, C. L., Johnson, R. A., & Wichern, D. W. (1989) · Technometrics · doi:10.2307/1268834 · Cited by 1,624
Noguchi, K., Gel, Y. R., Brunner, E., & Konietschke, F. (2012) · Journal of Statistical Software · doi:10.18637/jss.v050.i12 · Cited by 1,146 · cited 2×
“…rank-based methods for null hypotheses formulated in distribution functions are implemented within the packages npmv for oneand two-way MANOVA (Burchett et al., 2017) and nparLD for several repeated measures designs The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 (Noguchi et al., 2012).”
BackgroundMethodSelf-citationNonparametric analysis of longitudinal data in factorial experiments
Brunner, E., Domhof, S., & Langer, F. (2002) · Cited by 635
Nonparametric Analysis of Longitudinal Data in Factorial Experiments
Ghosh, S. (2003) · Technometrics · doi:10.1198/tech.2003.s161 · Cited by 585 · cited 1×
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodBox-Type Approximations in Nonparametric Factorial Designs
Brunner, E., Dette, H., & Munk, A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473671 · Cited by 272 · cited 2×
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodExact and asymptotically robust permutation tests
Chung, E., & Romano, J. P. (2013) · The Annals of Statistics · doi:10.1214/13-aos1090 · Cited by 239 · cited 2×
“, 2018) and ffmanova (Øyvind Langsrud and Mevik, 2019) contain interesting permutation and rotation tests, which, however, require certain invariances resulting in model restrictions (see, e.g., the discussion in Huang et al., 2006; Chung and Romano, 2013) .”
BackgroundNonparametric Inference for Multivariate Data: The R Package npmv
Burchett, W., Ellis, A. R., Harrar, S. W., & Bathke, A. C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i04 · Cited by 203 · cited 5×
“, 2006; Chung and Romano, 2013) . Most of these procedures, however, rely on specific distributional assumptions (such as multivariate normality) and/or specific covariance or correlation structures (e.g., homogeneity between groups or, for RM, compound symmetry; possibly implying equal correlation between measurement…”
BackgroundMethodInfluential
Research works printed but not linked: 4
- J. Fox and S. Weisberg. An R Companion to Applied Regression. Sage, Thousand Oaks CA, 2nd edition, 2011. URL http://socserv.socsci.mcmaster.ca/jfox/Books/Companion.
- T. Hothorn, F. Bretz, and P. Westfall. Simultaneous inference in general parametric models. Biometrical Journal, 50(3):346-363, 2008b.
- J. Lemon. Plotrix: a package in the red light district of r. R-News, 6(4):8-12, 2006.
- L. M. Lix and H. Keselman. Multivariate tests of means in independent groups designs: Effects of covariance heterogeneity and nonnormality. Evaluation & the Health Professions, 27(1):45-69, 2004.
Cited by
Sorted by citations
Devarajan, A. K., Muthukrishanan, G., Truu, J., Truu, M., Ostonen, I., Subramanian, S., Panneerselvam, P., & Gopalasubramaniam, S. K. (2021) · Plants · doi:10.3390/plants10020387 · Cited by 85
Heavy metal and pesticide levels in dairy products: Evaluation of human health risk
Năstăsescu, V., Mititelu, M., Γούμενου, Μ., Docea, A. O., Renieri, E. A., Udeanu, D. I., Oprea, E., Arsene, A. L., Dinu‐Pîrvu, C. E., & Ghica, M. (2020) · Food and Chemical Toxicology · doi:10.1016/j.fct.2020.111844 · Cited by 84
Höhn, C., Hahn, M. A., Lendner, J. D., & Hoedlmoser, K. (2024) · eNeuro · doi:10.1523/eneuro.0259-23.2024 · Cited by 76
“Since in most cases at least one assumption for parametrical testing was violated, we decided to compute more conservative semiparametrical analyses with the MANOVA.RM package (Friedrich et al., 2019).”
MethodVoormolen, D. C., Zeldovich, M., Haagsma, J. A., Polinder, S., Friedrich, S., Maas, A. I. R., Wilson, L., Steyerberg, E. W., Čović, A., Anđelić, N., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9051525 · Cited by 64
Self-citationGeng, Y., Wang, J., Sun, Z., Ji, C., Huang, M., Zhang, Y., Xu, P., Li, S., Pawlett, M., & Zou, J. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114730 · Cited by 61
Masoumzadeh, S., & Moussavi, Z. (2020) · Neuroscience Insights · doi:10.1177/2633105520967930 · Cited by 40
Schmid, L., Gerharz, A., Groll, A., & Pauly, M. (2022) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2022.107628 · Cited by 35
Self-citationKasimati, A., Psiroukis, V., Darra, N., Kalogrias, A., Kalivas, D. P., Taylor, J. A., & Fountas, S. (2023) · Precision Agriculture · doi:10.1007/s11119-022-09984-2 · Cited by 33
Assessing the ecological validity of soundscape reproduction in different laboratory settings
Tarlao, C., Steele, D., & Guastavino, C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270401 · Cited by 32
Page and screen: Storybook features that promote parent-child talk during shared reading
Strouse, G. A., Troseth, G. L., & Stuckelman, Z. D. (2023) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2023.101522 · Cited by 26
Krüger, I., Chartin, C., van Wesemael, B., & Carnol, M. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.08.010 · Cited by 24
Comparing Middle School Students’ Science Explanations During Physical and Virtual Laboratories
Gnesdilow, D., & Puntambekar, S. (2021) · Journal of Science Education and Technology · doi:10.1007/s10956-021-09941-0 · Cited by 23
“accounts for dependencies between results, potentially leading to more power to detect underlying effects (Friedrich et al., 2019).”
BackgroundDiet and foraging niche flexibility in green and hawksbill turtles
Clyde-Brockway, C. E., Heidemeyer, M., Paladino, F. V., & Flaherty, E. A. (2022) · Marine Biology · doi:10.1007/s00227-022-04092-1 · Cited by 22
Nikolic, S., Suesse, T., Grundy, S., Haque, R., Lyden, S., Hassan, G. M., Daniel, S., Belkina, M., & Lal, S. (2023) · European Journal of Engineering Education · doi:10.1080/03043797.2023.2248042 · Cited by 31
“The MANOVA p -value for Table 2 is Since there are no classic non-parametric alternatives to the MANOVA test (Kuskal-Wallis is the non-parametric alternative to ANOVA), a non-parametric Bootstrapping was applied to the MANOVA statistic (using the R package MANOVA.RM Friedrich, Konietschke, and Pauly 2019), obtaining v…”
MethodThe Impact of Response Instruction and Target Group on the BIAS Map
Findor, A., Lášticová, B., Hruška, M., Popper, M., & Váradi, L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.566725 · Cited by 21
“…the main effect of instruction and target group and their possible interaction we used robust non-parametric analysis of multivariate outcomes in factorial experiments via MANOVA.RM package (Friedrich et al., 2019), which allows for MANOVA-like test, but without assuming multivariate normality.”
MethodPheromone Mediated Sexual Reproduction of Pennate Diatom Cylindrotheca closterium
Klapper, F. A., Audoor, S., Vyverman, W., & Pohnert, G. (2021) · Journal of Chemical Ecology · doi:10.1007/s10886-021-01277-8 · Cited by 21
Kinematic analysis of activities of daily living performance in frail elderly
Schmidle, S., Gulde, P., Herdegen, S., Böhme, G.-E., & Hermsdörfer, J. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-02902-1 · Cited by 20
Jungert, A., Eichner, G., & Neuhäuser-Berthold, M. (2020) · Nutrients · doi:10.3390/nu12123626 · Cited by 19
Constrained flexibility of parental cooperation limits adaptive responses to harsh conditions
Moss, J. B., & Moore, A. J. (2021) · Evolution · doi:10.1111/evo.14285 · Cited by 19
“This was tested using a repeated-measures multivariate ANOVA (RM MANOVA) in the R package, MANOVA.RM (Version 0.4.3; Friedrich et al. 2019).”
MethodInfluentialMANOVA.RM: Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs
Friedrich, S., Konietschke, F., Pauly, M., & Modrzik, M. (2016) · doi:10.32614/cran.package.manova.rm · Cited by 18
Self-citationStatistical analysis of periodic data in neuroscience
Baker, D. H. (2021) · Neurons Behavior Data analysis and Theory · doi:10.51628/001c.27680 · Cited by 16
“RM package (Friedrich et al., 2019) is able to handle such designs appropriately using a bootstrapping approach.”
MethodStrohaeker, E. H., Moia, A., Steinmann, J., & Hagemeister, C. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.08.006 · Cited by 16
An online Trier social stress paradigm to evoke affective and cardiovascular responses
DuPont, C. M., Pressman, S. D., Reed, R. G., Manuck, S. B., Marsland, A. L., & Gianaros, P. J. (2022) · Psychophysiology · doi:10.1111/psyp.14067 · Cited by 16
DuPont, C. M., Pressman, S. D., Reed, R. G., Manuck, S. B., Marsland, A. L., & Gianaros, P. J. (2023) · Affective Science · doi:10.1007/s42761-022-00148-z · Cited by 13
Josupeit, J. (2023) · Frontiers in Virtual Reality · doi:10.3389/frvir.2023.1291078 · Cited by 14
Shaping city soundscapes: In situ comparison of four sound installations in an urban public space
Fraisse, V., Tarlao, C., & Guastavino, C. (2024) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2024.105173 · Cited by 14
Fiedler, M. L., Wolf, E., Döllinger, N., Mal, D., Botsch, M., Latoschik, M. E., & Wienrich, C. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456211 · Cited by 14
“Hence, we only partially confirmed hypothesis H1.”
Smilović, D., Rietsche, M., Drakew, A., Vukšić, M., & Deller, T. (2021) · The Journal of Comparative Neurology · doi:10.1002/cne.25237 · Cited by 14
Cellular plasticity facilitates phenotypic change in a dominant coral’s Symbiodiniaceae assemblage
Anthony, C. J., Lock, C., Taylor, B. M., & Bentlage, B. (2023) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2023.1288596 · Cited by 12
Variation among S-locus haplotypes and among stylar RNases in almond
Goonetilleke, S. N., Croxford, A. E., March, T. J., Wirthensohn, M. G., Hrmová, M., & Mather, D. E. (2020) · Scientific Reports · doi:10.1038/s41598-020-57498-6 · Cited by 12
Data analytics interrogates robotic surgical performance using a microsurgery-specific haptic device
Baghdadi, A., Hoshyarmanesh, H., de Lotbiniere-Bassett, M. P., Choi, S. K., Lama, S., & Sutherland, G. R. (2020) · Expert Review of Medical Devices · doi:10.1080/17434440.2020.1782736 · Cited by 12
Studivan, M. S., & Voss, J. D. (2020) · Molecular Ecology · doi:10.1111/mec.15495 · Cited by 12
Ryu, J. H., Subah, Z., & Baek, J. (2023) · Horticulturae · doi:10.3390/horticulturae9121318 · Cited by 11
On the Relationship Between IT Privacy and Security Behavior: A Survey Among German Private Users
Biselli, T., & Reuter, C. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86797-3_26 · Cited by 11
“This method was implemented using the MANOVA function from the R package “MANOVA.RM” [51].”
MethodBaldi, G., Salvemini, P., Attanasio, A. P., Mastrapasqua, T., Pepe, A. M., Ceriani, S. A., Oliverio, M., & Casale, P. (2022) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.3798 · Cited by 11
Filintas, A., Gougoulias, N., Kourgialas, N. N., & Hatzichristou, E. (2023) · Sustainability · doi:10.3390/su151813524 · Cited by 10
Delling, J. P., Bauer, H. F., Gerlach-Arbeiter, S., Schön, M., Jacob, C., Wagner, J., Pedro, M. T., Knöll, B., & Boeckers, T. M. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02559-9 · Cited by 10
“…0.20.2 [58], cluster 2.1.4 [59], pracma 2.4.2 [60], slingshot 2.4.0 [61], spatstat 3.0-3 [49], chisq.posthoc.test 0.1.2 [62], MANOVA.RM 0.5.3 [63], mvnormtest 0.1-9 [64], onewaytest 2.6 [65], rstatix 0.7.1 [66], factoextra 1.0.7 [67], ggplot2 3.4.0 [68], wesanderson 0.3.6 [69], and ggsignif…”
InfluentialN-Pep-12 supplementation after ischemic stroke positively impacts frequency domain QEEG
Popa, L. L., Iancu, M., Livinţ, G., Balea, M., Dina, C., Văcăraș, V., Vlădescu, C., Bălănescu, L., Buzoianu, A. D., Strilciuc, Ș., et al. (2021) · Neurological Sciences · doi:10.1007/s10072-021-05406-9 · Cited by 10
rankFD: An R Software Package for Nonparametric Analysis of General Factorial Designs
Konietschke, F., & Brunner, E. (2023) · The R Journal · doi:10.32614/rj-2023-029 · Cited by 10
“As an example of a one-way factorial design we use the data set EEG that is included in the package MANOVA.RM (Friedrich et al., 2019a, 2021).”
MethodSelf-citationSecret-keeping in therapy by clients who are sexually attracted to children
Jahnke, S., Blagden, N., McPhail, I. V., & Antfolk, J. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2265047 · Cited by 10
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, K., Mehta, R., Moukpe, J., Weekes, T. R., & Eskridge, T. C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2389350 · Cited by 10
“To test H1a and H1b, we performed a three-way MANOVA using the MANOVA.RM package (Friedrich et al., 2019) for the overall game scores, team-work, and team-task balancing workload scores.”
Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy
van Schalkwijk, F. J., Gruber, W. R., Miller, L. A., Trinka, E., & Höller, Y. (2021) · Brain Sciences · doi:10.3390/brainsci11020261 · Cited by 9
Gómez‐Soria, I., la Cruz, N. B., Cuenca‐Zaldívar, J. N., Calvo, S., Herrero, P., & Calatayud, E. (2021) · Clinical Gerontologist · doi:10.1080/07317115.2021.1937764 · Cited by 12
Angerer, M., Wilhelm, F. H., Liedlgruber, M., Pichler, G., Angerer, B., Scarpatetti, M., Blume, C., & Schabus, M. (2022) · Brain Sciences · doi:10.3390/brainsci12030375 · Cited by 9
Gourdine, J.-L., Fourcot, A., LeFloch, C., Navès, M., & Alexandre, G. (2021) · Tropical Animal Health and Production · doi:10.1007/s11250-021-02880-3 · Cited by 9
“To evaluate whether Creole breeds provide specific ES, farms composed of Creole animals (more than 80% of the animals present in the farm) were compared to other farms using a multivariate analysis of variance (MANOVA) with the package MANOVA-RM (Friedrich et al. 2018).”
MethodKrzikalla, C., Morina, N., Andor, T., Nohr, L., & Buhlmann, U. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282902 · Cited by 8
Filintas, A., Gougoulias, N., Kourgialas, N. N., & Hatzichristou, E. (2023) · Water · doi:10.3390/w15183278 · Cited by 8
Braun, D., Chappuis, V., Raabe, C., Suter, V. G. A., Fonseca, M., & Couso‐Queiruga, E. (2025) · Clinical Implant Dentistry and Related Research · doi:10.1111/cid.70005 · Cited by 8
Answering With Bow and Arrow: Questionnaires and VR Blend Without Distorting the Outcome
Gründling, J. P., Zeiler, D., & Weyers, B. (2022) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr51125.2022.00089 · Cited by 8
Rödig, T., Dullin, C., Kück, F., Krebs, M., Hettwer‐Steeger, I., & Haupt, F. (2022) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2022.105310 · Cited by 8
Ofir, S., Meilijson, I., Frenkel‐Toledo, S., & Soroker, N. (2022) · Human Brain Mapping · doi:10.1002/hbm.26105 · Cited by 7
“Since the AUC did not conform to a Gaussian distribution, we applied wild-bootstrap repeated-measures two-way ANOVA using “RM.MANOVA” R package (Friedrich et al., 2019) for analysis of the effect of perturbation depth (J = 1–6) and subcohort (LHD, RHD) on each AUC (two within-subjects factors,…”
MethodMaldonado, D., Acal, C., Ortiz, H., Aguilera, A. M., Ruiz‐Castro, J. E., Cantudo, A., Baroni, A., Reddy, K. D. S., Pechmann, S., Uhlmann, M., et al. (2025) · Materials Science in Semiconductor Processing · doi:10.1016/j.mssp.2025.109668 · Cited by 7
Köhler, J., Hidalgo, L., & Jara, J. L. (2023) · Applied Sciences · doi:10.3390/app132111994 · Cited by 7
Functional traits and trait coordination change over the life of a leaf in a tropical fern species
Krieg, C. P., Seeger, K., Campany, C., Watkins, J. E., McClearn, D., McCulloh, K. A., & Sessa, E. B. (2023) · American Journal of Botany · doi:10.1002/ajb2.16151 · Cited by 6
Forward effects from action observation: the role of attentional focus
Ianì, F., Limata, T., Ras, I. N., & Bucciarelli, M. (2023) · Psychological Research · doi:10.1007/s00426-023-01888-8 · Cited by 6
Quantile-based MANOVA: A new tool for inferring multivariate data in factorial designs
Baumeister, M., Ditzhaus, M., & Pauly, M. (2023) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2023.105246 · Cited by 6
Self-citationTheódórsdóttir, D., & Höller, Y. (2023) · Brain Sciences · doi:10.3390/brainsci14010002 · Cited by 6
Neurocomputational correlates of learned irrelevance in humans
Aberg, K. C., Kramer, E. E., & Schwartz, S. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116719 · Cited by 6
“In brief, instead of repeated measures ANOVAs we used an ANOVA-type statistic (ATS) and estimated p-values using a wild bootstrap procedure (as implemented in the freely available R package MANOVA.RM; Friedrich et al., 2018).”
MethodSavage, C. A. M., Owca, T. J., Kay, M. L., Faber, J. A., Wolfe, B. B., & Hall, R. I. (2021) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2021.100954 · Cited by 6
Bechert, U. S., Hixon, S., & Schmitt, D. L. (2021) · Zoo Biology · doi:10.1002/zoo.21619 · Cited by 7
Are High Frequency Oscillations in Scalp EEG Related to Age?
Windhager, P. F., Marcu, A. V., Trinka, E., Bathke, A. C., & Höller, Y. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2021.722657 · Cited by 6
Surveillance-Behavior Support by a Real-Time Gaze-Based Tool Integrated with Augmented Reality
Williot, A., Lafond, D., Tremblay, S., & Marois, A. (2024) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima61085.2024.10553855 · Cited by 5
“…the Scantracker group only were performed using nonparametric permutation tests with multRM (ANOVA-type statistic) function via MANOVA.RM package [34] and the npar.t.test.paired function from the nparcomp R package [35-36] for investigating the impact of Scantracker notifications and more…”
MethodEffects of Task Complexity and L2 Proficiency on Functional Adequacy in L2 Writing
Li, S., Wang, Z., & Ge, X. (2024) · International Journal of Applied Linguistics · doi:10.1111/ijal.12636 · Cited by 6
Gerner, N., Pickerle, D., Höller, Y., & Hartl, A. J. (2025) · Brain Sciences · doi:10.3390/brainsci15050432 · Cited by 6
Investigating Car Drivers’ Information Demand after Safety and Security Critical Incidents
Gröber, L., Fassl, M., Gupta, A., & Krombholz, K. (2021) · International Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3446862 · Cited by 5
EEG-Correlates of Emotional Memory and Seasonal Symptoms
Theódórsdóttir, D., & Höller, Y. (2023) · Applied Sciences · doi:10.3390/app13169361 · Cited by 5
Salonen, J., Slama, S., Haavisto, A., & Rosenqvist, J. (2023) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000395 · Cited by 5
“The differences in individual subtests and indexes were further analyzed using confidence intervals based on nonparametric bootstrapping with 5000 resamples using MANOVA.RM (Friedrich et al., 2019).”
MethodWefferling, K. M., Castro, M., Castro, S., Holmlund, H. I., Loureiro, J., Rothfels, C. J., & Schuettpelz, E. (2024) · American Journal of Botany · doi:10.1002/ajb2.16305 · Cited by 5
Cannabis Use Characteristics and PTSD-Related Outcomes Among Canadian Veterans With Chronic Pain
Sheehy, M. R., Storey, D. P., Rash, J. A., Tippin, G. K., Parihar, V., & Harris, N. M. (2025) · Journal of Veterans Studies · doi:10.21061/jvs.v11i1.582 · Cited by 5
Bolstering Policy Support for Disadvantaged Groups Through Humanization
Findor, A., Hruška, M., Hlatky, R., Dvorská, A., Hrustič, T., Bošeľová, Z., & Buchel, O. (2023) · Social Psychological and Personality Science · doi:10.1177/19485506231167494 · Cited by 4
“To analyze differences in outcomes across groups, we used a resampling-based MANOVA with 1,000 iterations (Friedrich et al., 2019).”
MethodShorter duration of slow wave sleep is related to symptoms of depression in patients with epilepsy
Eyjólfsdóttir, S. G., Trinka, E., & Höller, Y. (2023) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2023.109515 · Cited by 4
Testing hypotheses about correlation matrices in general MANOVA designs
Sattler, P., & Pauly, M. (2023) · Test · doi:10.1007/s11749-023-00906-6 · Cited by 4
Self-citationA Retrospective Analysis of Career Outcomes in Neuroscience
Ullrich, L. E., Ogawa, J. R., & Jones-London, M. D. (2024) · eNeuro · doi:10.1523/eneuro.0054-24.2024 · Cited by 4
Visual Field Asymmetries in Responses to ON and OFF Pathway Biasing Stimuli
Scott, M. T. W., Yakovleva, A., & Norcia, A. M. (2024) · Visual Neuroscience · doi:10.1017/s095252382400004x · Cited by 4
“A semi-parametric 3-way (contrast × pathway × VF) repeated measures ANOVA was carried out on RMS amplitudes using the RM() command of the MANOVA.RM package (Friedrich et al., 2019) in the R programming language.”
Consumer and critic reception of video game platforms: Trends from 2002–2022
Volckmann, W. M. (2023) · Entertainment Computing · doi:10.1016/j.entcom.2023.100599 · Cited by 4
Stuck in a (literal) tight spot: Cycling between tram rails, sharrows and parked cars
Ruf, S., Druba, J.-M., & Hagemeister, C. (2023) · Journal of Safety Research · doi:10.1016/j.jsr.2023.09.009 · Cited by 4
Ricci, C. A., Kamal, A. H. M., Chakrabarty, J. K., Ledbetter, B. E., Chowdhury, S. M., & Mydlarz, L. D. (2020) · Marine Biology · doi:10.1007/s00227-020-03680-3 · Cited by 4
Ravestein, D., Hendrikse, L. F., Veldhuis, G. J., Pennings, H. J. M., & Fonken, Y. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-23365-5 · Cited by 3
Warsinke, M., Vergari, M., Kojić, T., Nikulin, D., & Möller, S. (2025) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3756884.3766019 · Cited by 3
Limited Emotional Value Added by Immersive 3D Audio: A Reanalysis
Sander, K., Wycisk, Y., & Kopiez, R. (2023) · Music & Science · doi:10.1177/20592043231194751 · Cited by 3
“To circumvent issues resulting from violated theoretical preconditions (e.g., in fl ated type-I-errors), we used a nonparametric method with minimal assumptions regarding the data (R package MANOVA.RM, see Friedrich et al., 2019, 2022).”
BackgroundMethodGreco, D., Drakew, A., Rößler, N., Jungenitz, T., Jedlička, P., & Deller, T. (2025) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2024.1513511 · Cited by 3
Kavčič, A., Podlešek, A., Komidar, L., Hladnik, A., Podgornik, B. B., Bohak, C., Steiner, K. D., Gril, A., Lesar, Ž., Marolt, M., et al. (2022) · Sustainability · doi:10.3390/su14095686 · Cited by 3
Isotopic Evidence of Sources for Central California Olivella Beads
Burns, G. R., Eerkens, J. W., Spero, H. J., & Rosenthal, J. S. (2023) · California Archaeology · doi:10.1080/1947461x.2023.2173772 · Cited by 3
“Comparison between modern and ancient shell isotopic ranges was conducted in version 4.0.5 of the R statistical environment using the MANO-VA.RM package to conduct repeated measure MANOVA analysis (Friedrich, Konietschke, and Pauly 2019; R Core Team 2021).”
MethodInfluentialEffects of lead exposure on birds breeding in the Southeast Missouri Lead Mining District
Brasso, R. L., Cleveland, D. M., Thompson, F. R. I., Mosby, D. E., Hixson, K. M., Roach, M. C., Rattner, B. A., Karouna‐Renier, N. K., & Lankton, J. S. (2023) · Scientific investigations report · doi:10.3133/sir20235032 · Cited by 3
In a visual inverted pendulum balancing task avoiding impending falls gets harder as we age
Park, H., Bakshi, A., Lackner, J. R., & DiZio, P. A. (2025) · Experimental Brain Research · doi:10.1007/s00221-025-06997-x · Cited by 2
“All statistics were done using the MANOVA.RM package in RStudio (Friedrich et al. 2019) to conduct resampling-based hypothesis testing.”
Reflection on clinical and methodological issues in rare disease clinical trials.
Verbeeck, J., Geroldinger, M., Nyberg, J., Thiel, K. E., Hooker, A. C., Bathke, A. C., Bauer, J. W., Molenberghs, G., Laimer, M., & Zimmermann, G. (2025) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-025-03805-1 · Cited by 2
Volatile sulfur compounds in New Zealand Sauvignon blanc: An inter-regional survey
Manners, S. H., van Leeuwen, K. A., Gaw, S., Panicker, K., Gill, S., Dhami, M. K., Warden, N., Dobson, R. C. J., Fedrizzi, B., & Stott, M. B. (2025) · Food Chemistry · doi:10.1016/j.foodchem.2025.146369 · Cited by 2
Communicating biodiversity: How comics vs. informational messages influence food choice
Delvendahl, N., & Langen, N. (2025) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2025.146565 · Cited by 2
Adamus, M., Grežo, M., & Dudeková, K. (2021) · Studia Psychologica · doi:10.31577/sp.2021.03.824 · Cited by 4
“As suggested by Friedrich, Konietschke, and Pauly (2019), we used a Bonferroni’s correction to adjust the significance level to α = .017.”
MethodJosupeit, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0313313 · Cited by 2
Culture and attachment preference among young adults in Egypt and the United States
Abdellatif, M. A., Freeman, H., Strouse, G. A., & Mahmoud, N. A. W. (2025) · Attachment & Human Development · doi:10.1080/14616734.2025.2461315 · Cited by 2
“Therefore we used the MANOVA.wide function in the MANOVA.RM (v 0.5.2; Friedrich et al., 2021) package in R to resample p-values for MANOVA and ANOVA tests using parametric bootstrapping with 50,000 iterations (Friedrich et al., 2019).”
InfluentialNuñez, J. D., & Iriarte, P. F. (2022) · Marine Biology · doi:10.1007/s00227-022-04035-w · Cited by 2
Josupeit, J., & Andrees, F. (2024) · Smart innovation, systems and technologies · doi:10.1007/978-981-99-9018-4_9 · Cited by 2
Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact
Koul, A., & Novembre, G. (2026) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.70322 · Cited by 1
Coscioni, V., de Carvalho, C. L., Taveira, M. D. C., & Silva, A. D. (2023) · Current Psychology · doi:10.1007/s12144-023-04565-6 · Cited by 1
Zarantonello, L., Mangini, C., Erminelli, D., Fasolato, S., Angeli, P., Amodio, P., & Montagnese, S. (2023) · Neurochemical Research · doi:10.1007/s11064-023-04034-3 · Cited by 1
“…with one/two within factors we were carried out by the nparLD package ( post hoc : Wilcoxon test adjusted by Bonferroni) [37] and comparisons with more than two within factors by the Manova.RM package ( post hoc : Tuckey test adjusted by Bonferroni) [38] using R, version 1.2.5 (R core team, 2013).”
InfluentialPhrasal complexity in EFL learners’ oral performance: The role of task type and proficiency
Bao, G. (2025) · IRAL - International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2024-0273 · Cited by 1
“Given these violations, this study employed a robust repeated measures multi-variate analysis of variance to address the research questions (Friedrich et al. 2019).”
Removing facial features from structural MRI images biases visual quality assessment
Provins, C., Savary, É., Sanchez, T., Mullier, E., Barranco, J., Fischi-Gómez, E., Alemán‐Gómez, Y., Richiardi, J., Poldrack, R. A., Hagmann, P., et al. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003149 · Cited by 2
“RM package [39] in R .”
Lafenthaler, S., Höller, Y., Bergmann, J., Kirschner, M., Frey, V., Rossini, F., Trinka, E., & Staffen, W. (2025) · Aphasiology · doi:10.1080/02687038.2025.2520358 · Cited by 1
“We conducted a semi-parametric repeated measures ANOVA, suitable for non-normality and variance heterogeneity in small, unequal samples, via the RM function from the MANOVA.RM package (Bathke et al., 2018; Friedrich et al., 2018).”
Unigarro, C. A., Darghan, A. E., Salinas, D. G. C., & Flórez-Ramos, C. P. (2026) · Frontiers in Plant Science · doi:10.3389/fpls.2026.1860074 · Cited by 1
Metadata
- Authors
- Friedrich, S., Konietschke, F., & Pauly, M.
- Affiliations
- TU Dortmund University (DE)
- Venue
- The R Journal
- Publisher
- The R Foundation
- Published
- 2019
- Volume
- 11
- Issue
- 2
- Pages
- 380
- ISSN
- 2073-4859 (ISSN-L)
- OpenAlex
- W2998668315
- Cited by
- 131
- References
- 42
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 19 · 2023: 31 · 2022: 17 · 2021: 19 · 2020: 13
- FWCI
- 5.58
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- The R Journal (publishedVersion, cc-by)
- Lincoln (University of Nebraska) (submittedVersion, cc-by)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, other-oa)
- OPUS (Augsburg University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (DFG‐PA 2409/3‐1)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- repeated measures designs, longitudinal data, bootstrapping, permutation tests, multivariate normality, covariance structure, R package, graphical user interface, confidence intervals, p-value estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
