Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs with the R Package MANOVA.RM
Open accessAbstract
Nonparametric statistical inference methods for a modern and robust analysis of longitudinal and multivariate data in factorial experiments are essential for research.While existing approaches that rely on specific distributional assumptions of the data (multivariate normality and/or equal covariance matrices) are implemented in statistical software packages, there is a need for user-friendly software that can be used for the analysis of data that do not fulfill the aforementioned assumptions and provide accurate p value and confidence interval estimates.Therefore, newly developed nonparametric statistical methods based on bootstrap-and permutation-approaches, which neither assume multivariate normality nor specific covariance matrices, have been implemented in the freely available R package MANOVA.RM.The package is equipped with a graphical user interface for plausible applications in academia and other educational purpose.Several motivating examples illustrate the application of the methods.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The nonparametric RM-MANOVA does not rely on assumptions of multivariate normality or specific covariance structures, making it suitable even for data with non-normal error terms and/or heteroscedastic variances.
“This analysis does not rely on assumptions of multivariate normality or specific covariance structures in the data, making it suitable even for data with non‐normal error terms and/or heteroscedastic variances [58, 59].”
From Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact (2026) · cites this paper as [58]
Cites
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,950 · see citing works
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828 · cited 2× · see citing works
“Focusing on metric data and mean-based procedures, MANOVA and RM models are typically inferred by means of “classical” procedures such as Wilks’ Lambda, Lawley-Hotelling, Roy’s largest root (Davis, 2002; Johnson and Wichern, 2007; Anderson, 2001) or (generalized) linear mixed models with generalized estimating equatio…”
MethodApplied Multivariate Statistical Analysis
Härdle, W. K., & Simar, L. (2015) · Springer eBooks · doi:10.1007/978-3-662-45171-7 · Cited by 1,652 · see citing works
Noguchi, K., Gel, Y. R., Brunner, E., & Konietschke, F. (2012) · Journal of Statistical Software · doi:10.18637/jss.v050.i12 · Cited by 1,146 · cited 2× · see citing works
“…rank-based methods for null hypotheses formulated in distribution functions are implemented within the packages npmv for oneand two-way MANOVA (Burchett et al., 2017) and nparLD for several repeated measures designs The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 (Noguchi et al., 2012).”
BackgroundMethodSelf-citationApplied Multivariate Statistical Analysis
Dunn, C. L., Johnson, R. A., & Wichern, D. W. (1989) · Technometrics · doi:10.2307/1268834 · Cited by 1,108 · see citing works
Nonparametric analysis of longitudinal data in factorial experiments
Brunner, E., Domhof, S., & Langer, F. (2002) · Cited by 637 · see citing works
Nonparametric Analysis of Longitudinal Data in Factorial Experiments
Ghosh, S. (2003) · Technometrics · doi:10.1198/tech.2003.s161 · Cited by 585 · cited 1× · see citing works
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodBox-Type Approximations in Nonparametric Factorial Designs
Brunner, E., Dette, H., & Munk, A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473671 · Cited by 272 · cited 2× · see citing works
“…the The R Journal Vol. XX/YY, AAAA 20ZZ ISSN 2073-4859 well-established ANOVA-type statistic (ATS) QN = NX ′ •TX• (3) by Brunner (2001) is implemented together with the enhanced F-approximation of the statistic proposed in Brunner et al. (1997, 2002) and implemented in the SAS PROC Mixed procedure.”
MethodExact and asymptotically robust permutation tests
Chung, E., & Romano, J. P. (2013) · The Annals of Statistics · doi:10.1214/13-aos1090 · Cited by 239 · cited 2× · see citing works
“, 2018) and ffmanova (Øyvind Langsrud and Mevik, 2019) contain interesting permutation and rotation tests, which, however, require certain invariances resulting in model restrictions (see, e.g., the discussion in Huang et al., 2006; Chung and Romano, 2013) .”
BackgroundNonparametric Inference for Multivariate Data: The R Package npmv
Burchett, W., Ellis, A. R., Harrar, S. W., & Bathke, A. C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i04 · Cited by 203 · cited 5× · see citing works
“, 2006; Chung and Romano, 2013) . Most of these procedures, however, rely on specific distributional assumptions (such as multivariate normality) and/or specific covariance or correlation structures (e.g., homogeneity between groups or, for RM, compound symmetry; possibly implying equal correlation between measurement…”
BackgroundMethodInfluentialA solution to the multivariate behrens-fisher problem
Nel, D. G., & Merwe, C. A. V. D. (1986) · Communication in Statistics- Theory and Methods · doi:10.1080/03610928608829342 · Cited by 148 · see citing works
An Approximate Degrees of Freedom Solution to the Multivariate Behrens Fisher Problem
Yao, Y. (1965) · Biometrika · doi:10.1093/biomet/52.1-2.139 · Cited by 127 · cited 2× · see citing works
“In case of a = 2 this includes the famous multivariate Behrens-Fisher problem as, e.g., analyzed in Yao (1965); Nel and Van der Merwe (1986); Christensen and Rencher (1997); Krishnamoorthy and Yu (2004) or Yanagihara and Yuan (2005).”
BackgroundMethodParametric and nonparametric bootstrap methods for general MANOVA
Konietschke, F., Bathke, A. C., Harrar, S. W., & Pauly, M. (2015) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2015.05.001 · Cited by 125 · cited 7× · see citing works
“The validity of this procedure (also named parametric bootstrap WTS) is proven in Konietschke et al. (2015).”
BackgroundMethodInfluentialSelf-citationModified Nel and Van der Merwe test for the multivariate Behrens–Fisher problem
Krishnamoorthy, K., & Yu, J. (2003) · Statistics & Probability Letters · doi:10.1016/j.spl.2003.10.012 · Cited by 95 · cited 1× · see citing works
“In case of a = 2 this includes the famous multivariate Behrens-Fisher problem as, e.g., analyzed in Yao (1965); Nel and Van der Merwe (1986); Christensen and Rencher (1997); Krishnamoorthy and Yu (2004) or Yanagihara and Yuan (2005).”
MethodHuang, Y., Xu, H., Calian, V., & Hsu, J. C. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl383 · Cited by 84 · cited 1× · see citing works
“…the packages flip (Finos et al., 2018) and ffmanova (Øyvind Langsrud and Mevik, 2019) contain interesting permutation and rotation tests, which, however, require certain invariances resulting in model restrictions (see, e.g., the discussion in Huang et al., 2006; Chung and Romano, 2013) .”
BackgroundStatistical methods for the analysis of repeated measurements
(2002) · Choice Reviews Online · doi:10.5860/choice.39-6471 · Cited by 84 · see citing works
Permuting longitudinal data in spite of the dependencies
Friedrich, S., Brunner, E., & Pauly, M. (2016) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2016.10.004 · Cited by 79 · cited 14× · see citing works
“This test statistic tends to rather conservative decisions in case of small sample sizes and is even asymptotically only an approximation, thus not providing an asymptotic level α test, see Brunner (2001); Friedrich et al. (2017a).”
BackgroundMethodResultInfluentialSelf-citationMATS: Inference for potentially singular and heteroscedastic MANOVA
Friedrich, S., & Pauly, M. (2017) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2017.12.008 · Cited by 75 · cited 11× · see citing works
“…Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et al. (2016); Friedrich et al. (2017a); Livacic-Rojas et al. (2017); Friedrich and Pauly (2018) and the references cited therein.”
BackgroundMethodResultInfluentialSelf-citationMcFarquhar, M., McKie, S., Emsley, R., John Suckling, A., Elliott, R., & Williams, S. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.053 · Cited by 75 · cited 2× · see citing works
“…Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et al. (2016); Friedrich et al. (2017a); Livacic-Rojas et al. (2017); Friedrich and Pauly (2018) and the references cited therein.”
BackgroundBathke, A. C., Friedrich, S., Pauly, M., Konietschke, F., Staffen, W., Strobl, N., & Höller, Y. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1446320 · Cited by 66 · cited 11× · see citing works
“…Department of Neurology, University Clinic of Salzburg, 160 patients were diagnosed with either Alzheimer’s Disease (AD), mild cognitive impairment (MCI), or subjective cognitive complaints without clinically significant deficits (SCC), based on neuropsychological diagnostics (Bathke et al., 2018).”
BackgroundMethodResultInfluentialSelf-citationGFD: An R Package for the Analysis of General Factorial Designs
Friedrich, S., Konietschke, F., & Pauly, M. (2017) · Journal of Statistical Software · doi:10.18637/jss.v079.c01 · Cited by 53 · cited 9× · see citing works
“This test statistic tends to rather conservative decisions in case of small sample sizes and is even asymptotically only an approximation, thus not providing an asymptotic level α test, see Brunner (2001); Friedrich et al. (2017a).”
BackgroundMethodResultInfluentialSelf-citationellipse: Functions for Drawing Ellipses and Ellipse-Like Confidence Regions
Celayeta), D. M. A. E. D. C. (. T. R. B. J. M. F. (2000) · doi:10.32614/cran.package.ellipse · Cited by 53 · see citing works
Christensen, W. F., & Rencher, A. C. (1997) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610919708813439 · Cited by 45 · cited 3× · see citing works
“, analyzed in Yao (1965); Nel and Van der Merwe (1986); Christensen and Rencher (1997); Krishnamoorthy and Yu (2004) or Yanagihara and Yuan (2005). • Crossed Two-Way (A× B): Splitting the index into two and writing μij = ν + αi + βj + γij we obtain the model X ijk = ν + αi + βj + γij + eijk, 1 ≤ i ≤ a, 1 ≤ j ≤ b, 1 ≤…”
BackgroundMethodTwo-Way MANOVA With Unequal Cell Sizes and Unequal Cell Covariance Matrices
Zhang, J. (2011) · Technometrics · doi:10.1198/tech.2011.10128 · Cited by 44 · cited 2× · see citing works
“ive procedures have been developed that tackle the above problems and have been compared in extensive simulation studies, see amongst others Brunner (2001); Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2016); McFarqu…”
ResultThree Approximate Solutions to the Multivariate Behrens–Fisher Problem
Yanagihara, H., & Yuan, K. (2005) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910500308396 · Cited by 42 · see citing works
Vallejo, G., Fidalgo, A., & Fernández, P. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3601_01 · Cited by 35 · cited 2× · see citing works
“ustifiable in real data. In particular, with decreasing sample sizes and increasing dimensions, such presumptions are almost impossible to verify in practice and may lead to inflated type-I-errors, cf. Vallejo et al. (2001); Lix and Keselman (2004); Vallejo Seco et al. (2007); LivacicRojas et al. (2010). To this end, se…”
BackgroundMethodA modified two-factor multivariate analysis of variance: asymptotics and small sample approximations
Harrar, S. W., & Bathke, A. C. (2010) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-010-0299-0 · Cited by 31 · cited 1× · see citing works
“…and have been compared in extensive simulation studies, see amongst others Brunner (2001); Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et al. (2016); Friedrich et al. (2017a);…”
BackgroundLivacic-Rojas, P. E., Vallejo, G., & Fernández, P. (2010) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910903548952 · Cited by 25 · cited 1× · see citing works
“In particular, with decreasing sample sizes and increasing dimensions, such presumptions are almost impossible to verify in practice and may lead to inflated type-I-errors, cf. Vallejo et al. (2001); Lix and Keselman (2004); Vallejo Seco et al. (2007); Livacic-Rojas et al. (2010).”
BackgroundComparative Robustness of Recent Methods for Analyzing Multivariate Repeated Measures Designs
Vallejo, G., Gras, J. A., & García, M. A. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164406294777 · Cited by 25 · cited 2× · see citing works
“In particular, with decreasing sample sizes and increasing dimensions, such presumptions are almost impossible to verify in practice and may lead to inflated type-I-errors, cf. Vallejo et al. (2001); Lix and Keselman (2004); Vallejo Seco et al. (2007); Livacic-Rojas et al. (2010).”
BackgroundMANOVA for large hypothesis degrees of freedom under non-normality
Gupta, A. K., Harrar, S. W., & Fujikoshi, Y. (2007) · Test · doi:10.1007/s11749-006-0026-6 · Cited by 19 · cited 2× · see citing works
“…that tackle the above problems and have been compared in extensive simulation studies, see amongst others Brunner (2001); Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et…”
MethodResultMANOVA.RM: Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs
Friedrich, S., Konietschke, F., Pauly, M., & Modrzik, M. (2016) · doi:10.32614/cran.package.manova.rm · Cited by 18 · see citing works
Self-citationRGtk2: A Graphical User Interface Toolkit for R
Lang, D. T., & Lawrence, M. (2011) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6 · see citing works
HSAUR: A Handbook of Statistical Analyses Using R (1st Edition)
Hothorn, T., & Everitt, B. S. (2006) · doi:10.32614/cran.package.hsaur · Cited by 6 · see citing works
Power of Modified Brown-Forsythe and Mixed-Model Approaches in Split-Plot Designs
Livacic-Rojas, P. E., Vallejo, G., Fernández, P., & Herrero, E. T. (2017) · Methodology · doi:10.1027/1614-2241/a000124 · Cited by 5 · cited 1× · see citing works
“…Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et al. (2016); Friedrich et al. (2017a); Livacic-Rojas et al. (2017); Friedrich and Pauly (2018) and the references cited therein.”
BackgroundStatistical Methods for the Analysis of Repeated Measurements
Moeschberger, M. L. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s250 · Cited by 5 · see citing works
flip: Multivariate Permutation Tests
Finos, L. (2011) · doi:10.32614/cran.package.flip · Cited by 5 · see citing works
Langsrud, Ø., & Mevik, B. (2006) · doi:10.32614/cran.package.ffmanova · Cited by 5 · see citing works
A Comparison of Procedures for the Analysis of Multivariate Repeated Measurements
Lix, L. M., & Lloyd, A. M. (2007) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1193889840 · Cited by 4 · cited 2× · see citing works
“t al. (2010). To this end, several alternative procedures have been developed that tackle the above problems and have been compared in extensive simulation studies, see amongst others Brunner (2001); Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and…”
MethodResultSCGLR: Supervised Component Generalized Linear Regression
Cornu, G., Mortier, F., Trottier, C., Bry, X., & Chauvet, J. (2013) · doi:10.32614/cran.package.scglr · Cited by 4 · see citing works
Modified Tests for Heteroscedastic Two-Way MANOVA
Xiao, S., & Zhang, J. (2016) · Journal of Advanced Statistics · doi:10.22606/jas.2016.11001 · Cited by 2 · cited 2× · see citing works
“…see amongst others Brunner (2001); Lix and Lloyd (2007); Gupta et al. (2008); Zhang (2011); Harrar and Bathke (2012); Konietschke et al. (2015); Xiao and Zhang (2016); Bathke et al. (2018); McFarquhar et al. (2016); Friedrich et al. (2017a); Livacic-Rojas et al. (2017); Friedrich and Pauly…”
Background
Flagged first, then by citations
2 of the 42 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Devarajan, A. K., Muthukrishanan, G., Truu, J., Truu, M., Ostonen, I., Subramanian, S., Panneerselvam, P., & Gopalasubramaniam, S. K. (2021) · Plants · doi:10.3390/plants10020387 · Cited by 85 · see citing works
Heavy metal and pesticide levels in dairy products: Evaluation of human health risk
Năstăsescu, V., Mititelu, M., Γούμενου, Μ., Docea, A. O., Renieri, E. A., Udeanu, D. I., Oprea, E., Arsene, A. L., Dinu‐Pîrvu, C. E., & Ghica, M. (2020) · Food and Chemical Toxicology · doi:10.1016/j.fct.2020.111844 · Cited by 84 · see citing works
Höhn, C., Hahn, M. A., Lendner, J. D., & Hoedlmoser, K. (2024) · eNeuro · doi:10.1523/eneuro.0259-23.2024 · Cited by 67 · see citing works
“Since in most cases at least one assumption for parametrical testing was violated, we decided to compute more conservative semiparametrical analyses with the MANOVA.RM package (Friedrich et al., 2019).”
MethodVoormolen, D. C., Zeldovich, M., Haagsma, J. A., Polinder, S., Friedrich, S., Maas, A. I. R., Wilson, L., Steyerberg, E. W., Čović, A., Anđelić, N., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9051525 · Cited by 64 · see citing works
Self-citationGeng, Y., Wang, J., Sun, Z., Ji, C., Huang, M., Zhang, Y., Xu, P., Li, S., Pawlett, M., & Zou, J. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114730 · Cited by 61 · see citing works
Masoumzadeh, S., & Moussavi, Z. (2020) · Neuroscience Insights · doi:10.1177/2633105520967930 · Cited by 40 · see citing works
Schmid, L., Gerharz, A., Groll, A., & Pauly, M. (2022) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2022.107628 · Cited by 35 · see citing works
Self-citationKasimati, A., Psiroukis, V., Darra, N., Kalogrias, A., Kalivas, D. P., Taylor, J. A., & Fountas, S. (2023) · Precision Agriculture · doi:10.1007/s11119-022-09984-2 · Cited by 33 · see citing works
Assessing the ecological validity of soundscape reproduction in different laboratory settings
Tarlao, C., Steele, D., & Guastavino, C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270401 · Cited by 32 · see citing works
Page and screen: Storybook features that promote parent-child talk during shared reading
Strouse, G. A., Troseth, G. L., & Stuckelman, Z. D. (2023) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2023.101522 · Cited by 26 · see citing works
Krüger, I., Chartin, C., van Wesemael, B., & Carnol, M. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.08.010 · Cited by 24 · see citing works
Comparing Middle School Students’ Science Explanations During Physical and Virtual Laboratories
Gnesdilow, D., & Puntambekar, S. (2021) · Journal of Science Education and Technology · doi:10.1007/s10956-021-09941-0 · Cited by 23 · see citing works
“accounts for dependencies between results, potentially leading to more power to detect underlying effects (Friedrich et al., 2019).”
BackgroundDiet and foraging niche flexibility in green and hawksbill turtles
Clyde-Brockway, C. E., Heidemeyer, M., Paladino, F. V., & Flaherty, E. A. (2022) · Marine Biology · doi:10.1007/s00227-022-04092-1 · Cited by 22 · see citing works
Nikolic, S., Suesse, T., Grundy, S., Haque, R., Lyden, S., Hassan, G. M., Daniel, S., Belkina, M., & Lal, S. (2023) · European Journal of Engineering Education · doi:10.1080/03043797.2023.2248042 · Cited by 31 · see citing works
“The MANOVA p -value for Table 2 is Since there are no classic non-parametric alternatives to the MANOVA test (Kuskal-Wallis is the non-parametric alternative to ANOVA), a non-parametric Bootstrapping was applied to the MANOVA statistic (using the R package MANOVA.RM Friedrich, Konietschke, and Pauly 2019), obtaining v…”
MethodThe Impact of Response Instruction and Target Group on the BIAS Map
Findor, A., Lášticová, B., Hruška, M., Popper, M., & Váradi, L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.566725 · Cited by 21 · see citing works
“…the main effect of instruction and target group and their possible interaction we used robust non-parametric analysis of multivariate outcomes in factorial experiments via MANOVA.RM package (Friedrich et al., 2019), which allows for MANOVA-like test, but without assuming multivariate normality.”
MethodPheromone Mediated Sexual Reproduction of Pennate Diatom Cylindrotheca closterium
Klapper, F. A., Audoor, S., Vyverman, W., & Pohnert, G. (2021) · Journal of Chemical Ecology · doi:10.1007/s10886-021-01277-8 · Cited by 21 · see citing works
Kinematic analysis of activities of daily living performance in frail elderly
Schmidle, S., Gulde, P., Herdegen, S., Böhme, G.-E., & Hermsdörfer, J. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-02902-1 · Cited by 20 · see citing works
Jungert, A., Eichner, G., & Neuhäuser-Berthold, M. (2020) · Nutrients · doi:10.3390/nu12123626 · Cited by 19 · see citing works
Constrained flexibility of parental cooperation limits adaptive responses to harsh conditions
Moss, J. B., & Moore, A. J. (2021) · Evolution · doi:10.1111/evo.14285 · Cited by 19 · see citing works
“This was tested using a repeated-measures multivariate ANOVA (RM MANOVA) in the R package, MANOVA.RM (Version 0.4.3; Friedrich et al. 2019).”
MethodInfluentialMANOVA.RM: Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs
Friedrich, S., Konietschke, F., Pauly, M., & Modrzik, M. (2016) · doi:10.32614/cran.package.manova.rm · Cited by 18 · see citing works
Self-citationStatistical analysis of periodic data in neuroscience
Baker, D. H. (2021) · Neurons Behavior Data analysis and Theory · doi:10.51628/001c.27680 · Cited by 16 · see citing works
“RM package (Friedrich et al., 2019) is able to handle such designs appropriately using a bootstrapping approach.”
MethodStrohaeker, E. H., Moia, A., Steinmann, J., & Hagemeister, C. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.08.006 · Cited by 16 · see citing works
An online Trier social stress paradigm to evoke affective and cardiovascular responses
DuPont, C. M., Pressman, S. D., Reed, R. G., Manuck, S. B., Marsland, A. L., & Gianaros, P. J. (2022) · Psychophysiology · doi:10.1111/psyp.14067 · Cited by 16 · see citing works
DuPont, C. M., Pressman, S. D., Reed, R. G., Manuck, S. B., Marsland, A. L., & Gianaros, P. J. (2023) · Affective Science · doi:10.1007/s42761-022-00148-z · Cited by 13 · see citing works
Josupeit, J. (2023) · Frontiers in Virtual Reality · doi:10.3389/frvir.2023.1291078 · Cited by 14 · see citing works
Shaping city soundscapes: In situ comparison of four sound installations in an urban public space
Fraisse, V., Tarlao, C., & Guastavino, C. (2024) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2024.105173 · Cited by 14 · see citing works
Fiedler, M. L., Wolf, E., Döllinger, N., Mal, D., Botsch, M., Latoschik, M. E., & Wienrich, C. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456211 · Cited by 14 · see citing works
“Hence, we only partially confirmed hypothesis H1.”
Smilović, D., Rietsche, M., Drakew, A., Vukšić, M., & Deller, T. (2021) · The Journal of Comparative Neurology · doi:10.1002/cne.25237 · Cited by 13 · see citing works
Cellular plasticity facilitates phenotypic change in a dominant coral’s Symbiodiniaceae assemblage
Anthony, C. J., Lock, C., Taylor, B. M., & Bentlage, B. (2023) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2023.1288596 · Cited by 13 · see citing works
Variation among S-locus haplotypes and among stylar RNases in almond
Goonetilleke, S. N., Croxford, A. E., March, T. J., Wirthensohn, M. G., Hrmová, M., & Mather, D. E. (2020) · Scientific Reports · doi:10.1038/s41598-020-57498-6 · Cited by 12 · see citing works
Data analytics interrogates robotic surgical performance using a microsurgery-specific haptic device
Baghdadi, A., Hoshyarmanesh, H., de Lotbiniere-Bassett, M. P., Choi, S. K., Lama, S., & Sutherland, G. R. (2020) · Expert Review of Medical Devices · doi:10.1080/17434440.2020.1782736 · Cited by 12 · see citing works
Studivan, M. S., & Voss, J. D. (2020) · Molecular Ecology · doi:10.1111/mec.15495 · Cited by 12 · see citing works
Ryu, J. H., Subah, Z., & Baek, J. (2023) · Horticulturae · doi:10.3390/horticulturae9121318 · Cited by 11 · see citing works
On the Relationship Between IT Privacy and Security Behavior: A Survey Among German Private Users
Biselli, T., & Reuter, C. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86797-3_26 · Cited by 11 · see citing works
“This method was implemented using the MANOVA function from the R package “MANOVA.RM” [51].”
MethodBaldi, G., Salvemini, P., Attanasio, A. P., Mastrapasqua, T., Pepe, A. M., Ceriani, S. A., Oliverio, M., & Casale, P. (2022) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.3798 · Cited by 11 · see citing works
Filintas, A., Gougoulias, N., Kourgialas, N. N., & Hatzichristou, E. (2023) · Sustainability · doi:10.3390/su151813524 · Cited by 10 · see citing works
Delling, J. P., Bauer, H. F., Gerlach-Arbeiter, S., Schön, M., Jacob, C., Wagner, J., Pedro, M. T., Knöll, B., & Boeckers, T. M. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02559-9 · Cited by 10 · see citing works
“…0.20.2 [58], cluster 2.1.4 [59], pracma 2.4.2 [60], slingshot 2.4.0 [61], spatstat 3.0-3 [49], chisq.posthoc.test 0.1.2 [62], MANOVA.RM 0.5.3 [63], mvnormtest 0.1-9 [64], onewaytest 2.6 [65], rstatix 0.7.1 [66], factoextra 1.0.7 [67], ggplot2 3.4.0 [68], wesanderson 0.3.6 [69], and ggsignif…”
InfluentialN-Pep-12 supplementation after ischemic stroke positively impacts frequency domain QEEG
Popa, L. L., Iancu, M., Livinţ, G., Balea, M., Dina, C., Văcăraș, V., Vlădescu, C., Bălănescu, L., Buzoianu, A. D., Strilciuc, Ș., et al. (2021) · Neurological Sciences · doi:10.1007/s10072-021-05406-9 · Cited by 10 · see citing works
rankFD: An R Software Package for Nonparametric Analysis of General Factorial Designs
Konietschke, F., & Brunner, E. (2023) · The R Journal · doi:10.32614/rj-2023-029 · Cited by 10 · see citing works
“As an example of a one-way factorial design we use the data set EEG that is included in the package MANOVA.RM (Friedrich et al., 2019a, 2021).”
MethodSelf-citationSecret-keeping in therapy by clients who are sexually attracted to children
Jahnke, S., Blagden, N., McPhail, I. V., & Antfolk, J. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2265047 · Cited by 10 · see citing works
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, K., Mehta, R., Moukpe, J., Weekes, T. R., & Eskridge, T. C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2389350 · Cited by 9 · see citing works
“To test H1a and H1b, we performed a three-way MANOVA using the MANOVA.RM package (Friedrich et al., 2019) for the overall game scores, team-work, and team-task balancing workload scores.”
Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy
van Schalkwijk, F. J., Gruber, W. R., Miller, L. A., Trinka, E., & Höller, Y. (2021) · Brain Sciences · doi:10.3390/brainsci11020261 · Cited by 9 · see citing works
Gómez‐Soria, I., la Cruz, N. B., Cuenca‐Zaldívar, J. N., Calvo, S., Herrero, P., & Calatayud, E. (2021) · Clinical Gerontologist · doi:10.1080/07317115.2021.1937764 · Cited by 9 · see citing works
Angerer, M., Wilhelm, F. H., Liedlgruber, M., Pichler, G., Angerer, B., Scarpatetti, M., Blume, C., & Schabus, M. (2022) · Brain Sciences · doi:10.3390/brainsci12030375 · Cited by 9 · see citing works
Gourdine, J.-L., Fourcot, A., LeFloch, C., Navès, M., & Alexandre, G. (2021) · Tropical Animal Health and Production · doi:10.1007/s11250-021-02880-3 · Cited by 9 · see citing works
“To evaluate whether Creole breeds provide specific ES, farms composed of Creole animals (more than 80% of the animals present in the farm) were compared to other farms using a multivariate analysis of variance (MANOVA) with the package MANOVA-RM (Friedrich et al. 2018).”
MethodFilintas, A., Gougoulias, N., Kourgialas, N. N., & Hatzichristou, E. (2023) · Water · doi:10.3390/w15183278 · Cited by 8 · see citing works
Braun, D., Chappuis, V., Raabe, C., Suter, V. G. A., Fonseca, M., & Couso‐Queiruga, E. (2025) · Clinical Implant Dentistry and Related Research · doi:10.1111/cid.70005 · Cited by 8 · see citing works
Answering With Bow and Arrow: Questionnaires and VR Blend Without Distorting the Outcome
Gründling, J. P., Zeiler, D., & Weyers, B. (2022) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr51125.2022.00089 · Cited by 8 · see citing works
Rödig, T., Dullin, C., Kück, F., Krebs, M., Hettwer‐Steeger, I., & Haupt, F. (2022) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2022.105310 · Cited by 8 · see citing works
Ofir, S., Meilijson, I., Frenkel‐Toledo, S., & Soroker, N. (2022) · Human Brain Mapping · doi:10.1002/hbm.26105 · Cited by 7 · see citing works
“Since the AUC did not conform to a Gaussian distribution, we applied wild-bootstrap repeated-measures two-way ANOVA using “RM.MANOVA” R package (Friedrich et al., 2019) for analysis of the effect of perturbation depth (J = 1–6) and subcohort (LHD, RHD) on each AUC (two within-subjects factors,…”
MethodMaldonado, D., Acal, C., Ortiz, H., Aguilera, A. M., Ruiz‐Castro, J. E., Cantudo, A., Baroni, A., Reddy, K. D. S., Pechmann, S., Uhlmann, M., et al. (2025) · Materials Science in Semiconductor Processing · doi:10.1016/j.mssp.2025.109668 · Cited by 7 · see citing works
Köhler, J., Hidalgo, L., & Jara, J. L. (2023) · Applied Sciences · doi:10.3390/app132111994 · Cited by 7 · see citing works
Functional traits and trait coordination change over the life of a leaf in a tropical fern species
Krieg, C. P., Seeger, K., Campany, C., Watkins, J. E., McClearn, D., McCulloh, K. A., & Sessa, E. B. (2023) · American Journal of Botany · doi:10.1002/ajb2.16151 · Cited by 6 · see citing works
Forward effects from action observation: the role of attentional focus
Ianì, F., Limata, T., Ras, I. N., & Bucciarelli, M. (2023) · Psychological Research · doi:10.1007/s00426-023-01888-8 · Cited by 6 · see citing works
Quantile-based MANOVA: A new tool for inferring multivariate data in factorial designs
Baumeister, M., Ditzhaus, M., & Pauly, M. (2023) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2023.105246 · Cited by 6 · see citing works
Self-citationTheódórsdóttir, D., & Höller, Y. (2023) · Brain Sciences · doi:10.3390/brainsci14010002 · Cited by 6 · see citing works
Neurocomputational correlates of learned irrelevance in humans
Aberg, K. C., Kramer, E. E., & Schwartz, S. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116719 · Cited by 6 · see citing works
“In brief, instead of repeated measures ANOVAs we used an ANOVA-type statistic (ATS) and estimated p-values using a wild bootstrap procedure (as implemented in the freely available R package MANOVA.RM; Friedrich et al., 2018).”
MethodSavage, C. A. M., Owca, T. J., Kay, M. L., Faber, J. A., Wolfe, B. B., & Hall, R. I. (2021) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2021.100954 · Cited by 6 · see citing works
Bechert, U. S., Hixon, S., & Schmitt, D. L. (2021) · Zoo Biology · doi:10.1002/zoo.21619 · Cited by 6 · see citing works
Are High Frequency Oscillations in Scalp EEG Related to Age?
Windhager, P. F., Marcu, A. V., Trinka, E., Bathke, A. C., & Höller, Y. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2021.722657 · Cited by 6 · see citing works
Surveillance-Behavior Support by a Real-Time Gaze-Based Tool Integrated with Augmented Reality
Williot, A., Lafond, D., Tremblay, S., & Marois, A. (2024) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima61085.2024.10553855 · Cited by 5 · see citing works
“…the Scantracker group only were performed using nonparametric permutation tests with multRM (ANOVA-type statistic) function via MANOVA.RM package [34] and the npar.t.test.paired function from the nparcomp R package [35-36] for investigating the impact of Scantracker notifications and more…”
MethodEffects of Task Complexity and L2 Proficiency on Functional Adequacy in L2 Writing
Li, S., Wang, Z., & Ge, X. (2024) · International Journal of Applied Linguistics · doi:10.1111/ijal.12636 · Cited by 5 · see citing works
Gerner, N., Pickerle, D., Höller, Y., & Hartl, A. J. (2025) · Brain Sciences · doi:10.3390/brainsci15050432 · Cited by 5 · see citing works
Investigating Car Drivers’ Information Demand after Safety and Security Critical Incidents
Gröber, L., Fassl, M., Gupta, A., & Krombholz, K. (2021) · International Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3446862 · Cited by 5 · see citing works
EEG-Correlates of Emotional Memory and Seasonal Symptoms
Theódórsdóttir, D., & Höller, Y. (2023) · Applied Sciences · doi:10.3390/app13169361 · Cited by 5 · see citing works
Salonen, J., Slama, S., Haavisto, A., & Rosenqvist, J. (2023) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000395 · Cited by 5 · see citing works
“The differences in individual subtests and indexes were further analyzed using confidence intervals based on nonparametric bootstrapping with 5000 resamples using MANOVA.RM (Friedrich et al., 2019).”
MethodWefferling, K. M., Castro, M., Castro, S., Holmlund, H. I., Loureiro, J., Rothfels, C. J., & Schuettpelz, E. (2024) · American Journal of Botany · doi:10.1002/ajb2.16305 · Cited by 5 · see citing works
Cannabis Use Characteristics and PTSD-Related Outcomes Among Canadian Veterans With Chronic Pain
Sheehy, M. R., Storey, D. P., Rash, J. A., Tippin, G. K., Parihar, V., & Harris, N. M. (2025) · Journal of Veterans Studies · doi:10.21061/jvs.v11i1.582 · Cited by 4 · see citing works
Bolstering Policy Support for Disadvantaged Groups Through Humanization
Findor, A., Hruška, M., Hlatky, R., Dvorská, A., Hrustič, T., Bošeľová, Z., & Buchel, O. (2023) · Social Psychological and Personality Science · doi:10.1177/19485506231167494 · Cited by 4 · see citing works
“To analyze differences in outcomes across groups, we used a resampling-based MANOVA with 1,000 iterations (Friedrich et al., 2019).”
MethodShorter duration of slow wave sleep is related to symptoms of depression in patients with epilepsy
Eyjólfsdóttir, S. G., Trinka, E., & Höller, Y. (2023) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2023.109515 · Cited by 4 · see citing works
Testing hypotheses about correlation matrices in general MANOVA designs
Sattler, P., & Pauly, M. (2023) · Test · doi:10.1007/s11749-023-00906-6 · Cited by 4 · see citing works
Self-citationA Retrospective Analysis of Career Outcomes in Neuroscience
Ullrich, L. E., Ogawa, J. R., & Jones-London, M. D. (2024) · eNeuro · doi:10.1523/eneuro.0054-24.2024 · Cited by 4 · see citing works
Visual Field Asymmetries in Responses to ON and OFF Pathway Biasing Stimuli
Scott, M. T. W., Yakovleva, A., & Norcia, A. M. (2024) · Visual Neuroscience · doi:10.1017/s095252382400004x · Cited by 4 · see citing works
“A semi-parametric 3-way (contrast × pathway × VF) repeated measures ANOVA was carried out on RMS amplitudes using the RM() command of the MANOVA.RM package (Friedrich et al., 2019) in the R programming language.”
Consumer and critic reception of video game platforms: Trends from 2002–2022
Volckmann, W. M. (2023) · Entertainment Computing · doi:10.1016/j.entcom.2023.100599 · Cited by 4 · see citing works
Stuck in a (literal) tight spot: Cycling between tram rails, sharrows and parked cars
Ruf, S., Druba, J.-M., & Hagemeister, C. (2023) · Journal of Safety Research · doi:10.1016/j.jsr.2023.09.009 · Cited by 4 · see citing works
Ricci, C. A., Kamal, A. H. M., Chakrabarty, J. K., Ledbetter, B. E., Chowdhury, S. M., & Mydlarz, L. D. (2020) · Marine Biology · doi:10.1007/s00227-020-03680-3 · Cited by 4 · see citing works
Krzikalla, C., Morina, N., Andor, T., Nohr, L., & Buhlmann, U. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282902 · Cited by 3 · see citing works
Ravestein, D., Hendrikse, L. F., Veldhuis, G. J., Pennings, H. J. M., & Fonken, Y. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-23365-5 · Cited by 3 · see citing works
Warsinke, M., Vergari, M., Kojić, T., Nikulin, D., & Möller, S. (2025) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3756884.3766019 · Cited by 3 · see citing works
Limited Emotional Value Added by Immersive 3D Audio: A Reanalysis
Sander, K., Wycisk, Y., & Kopiez, R. (2023) · Music & Science · doi:10.1177/20592043231194751 · Cited by 3 · see citing works
“To circumvent issues resulting from violated theoretical preconditions (e.g., in fl ated type-I-errors), we used a nonparametric method with minimal assumptions regarding the data (R package MANOVA.RM, see Friedrich et al., 2019, 2022).”
BackgroundMethodGreco, D., Drakew, A., Rößler, N., Jungenitz, T., Jedlička, P., & Deller, T. (2025) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2024.1513511 · Cited by 3 · see citing works
Kavčič, A., Podlešek, A., Komidar, L., Hladnik, A., Podgornik, B. B., Bohak, C., Steiner, K. D., Gril, A., Lesar, Ž., Marolt, M., et al. (2022) · Sustainability · doi:10.3390/su14095686 · Cited by 3 · see citing works
Isotopic Evidence of Sources for Central California Olivella Beads
Burns, G. R., Eerkens, J. W., Spero, H. J., & Rosenthal, J. S. (2023) · California Archaeology · doi:10.1080/1947461x.2023.2173772 · Cited by 3 · see citing works
“Comparison between modern and ancient shell isotopic ranges was conducted in version 4.0.5 of the R statistical environment using the MANO-VA.RM package to conduct repeated measure MANOVA analysis (Friedrich, Konietschke, and Pauly 2019; R Core Team 2021).”
MethodInfluentialEffects of lead exposure on birds breeding in the Southeast Missouri Lead Mining District
Brasso, R. L., Cleveland, D. M., Thompson, F. R. I., Mosby, D. E., Hixson, K. M., Roach, M. C., Rattner, B. A., Karouna‐Renier, N. K., & Lankton, J. S. (2023) · Scientific investigations report · doi:10.3133/sir20235032 · Cited by 3 · see citing works
In a visual inverted pendulum balancing task avoiding impending falls gets harder as we age
Park, H., Bakshi, A., Lackner, J. R., & DiZio, P. A. (2025) · Experimental Brain Research · doi:10.1007/s00221-025-06997-x · Cited by 2 · see citing works
“All statistics were done using the MANOVA.RM package in RStudio (Friedrich et al. 2019) to conduct resampling-based hypothesis testing.”
Reflection on clinical and methodological issues in rare disease clinical trials.
Verbeeck, J., Geroldinger, M., Nyberg, J., Thiel, K. E., Hooker, A. C., Bathke, A. C., Bauer, J. W., Molenberghs, G., Laimer, M., & Zimmermann, G. (2025) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-025-03805-1 · Cited by 2 · see citing works
Volatile sulfur compounds in New Zealand Sauvignon blanc: An inter-regional survey
Manners, S. H., van Leeuwen, K. A., Gaw, S., Panicker, K., Gill, S., Dhami, M. K., Warden, N., Dobson, R. C. J., Fedrizzi, B., & Stott, M. B. (2025) · Food Chemistry · doi:10.1016/j.foodchem.2025.146369 · Cited by 2 · see citing works
Communicating biodiversity: How comics vs. informational messages influence food choice
Delvendahl, N., & Langen, N. (2025) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2025.146565 · Cited by 2 · see citing works
Adamus, M., Grežo, M., & Dudeková, K. (2021) · Studia Psychologica · doi:10.31577/sp.2021.03.824 · Cited by 2 · see citing works
“As suggested by Friedrich, Konietschke, and Pauly (2019), we used a Bonferroni’s correction to adjust the significance level to α = .017.”
MethodJosupeit, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0313313 · Cited by 2 · see citing works
Culture and attachment preference among young adults in Egypt and the United States
Abdellatif, M. A., Freeman, H., Strouse, G. A., & Mahmoud, N. A. W. (2025) · Attachment & Human Development · doi:10.1080/14616734.2025.2461315 · Cited by 2 · see citing works
“Therefore we used the MANOVA.wide function in the MANOVA.RM (v 0.5.2; Friedrich et al., 2021) package in R to resample p-values for MANOVA and ANOVA tests using parametric bootstrapping with 50,000 iterations (Friedrich et al., 2019).”
InfluentialNuñez, J. D., & Iriarte, P. F. (2022) · Marine Biology · doi:10.1007/s00227-022-04035-w · Cited by 2 · see citing works
Josupeit, J., & Andrees, F. (2024) · Smart innovation, systems and technologies · doi:10.1007/978-981-99-9018-4_9 · Cited by 2 · see citing works
Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact
Koul, A., & Novembre, G. (2026) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.70322 · Cited by 1 · see citing works
Coscioni, V., de Carvalho, C. L., Taveira, M. D. C., & Silva, A. D. (2023) · Current Psychology · doi:10.1007/s12144-023-04565-6 · Cited by 1 · see citing works
Zarantonello, L., Mangini, C., Erminelli, D., Fasolato, S., Angeli, P., Amodio, P., & Montagnese, S. (2023) · Neurochemical Research · doi:10.1007/s11064-023-04034-3 · Cited by 1 · see citing works
“…with one/two within factors we were carried out by the nparLD package ( post hoc : Wilcoxon test adjusted by Bonferroni) [37] and comparisons with more than two within factors by the Manova.RM package ( post hoc : Tuckey test adjusted by Bonferroni) [38] using R, version 1.2.5 (R core team, 2013).”
InfluentialPhrasal complexity in EFL learners’ oral performance: The role of task type and proficiency
Bao, G. (2025) · IRAL - International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2024-0273 · Cited by 1 · see citing works
“Given these violations, this study employed a robust repeated measures multi-variate analysis of variance to address the research questions (Friedrich et al. 2019).”
Removing facial features from structural MRI images biases visual quality assessment
Provins, C., Savary, É., Sanchez, T., Mullier, E., Barranco, J., Fischi-Gómez, E., Alemán‐Gómez, Y., Richiardi, J., Poldrack, R. A., Hagmann, P., et al. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003149 · Cited by 1 · see citing works
“RM package [39] in R .”
Lafenthaler, S., Höller, Y., Bergmann, J., Kirschner, M., Frey, V., Rossini, F., Trinka, E., & Staffen, W. (2025) · Aphasiology · doi:10.1080/02687038.2025.2520358 · Cited by 1 · see citing works
“We conducted a semi-parametric repeated measures ANOVA, suitable for non-normality and variance heterogeneity in small, unequal samples, via the RM function from the MANOVA.RM package (Bathke et al., 2018; Friedrich et al., 2018).”
Unigarro, C. A., Darghan, A. E., Salinas, D. G. C., & Flórez-Ramos, C. P. (2026) · Frontiers in Plant Science · doi:10.3389/fpls.2026.1860074 · Cited by 1 · see citing works
- Authors
- Friedrich, S., Konietschke, F., & Pauly, M.
- Affiliations
- TU Dortmund University (DE)
- Venue
- The R Journal
- Publisher
- The R Foundation
- Published
- 2019
- Volume
- 11
- Issue
- 2
- Pages
- 380
- ISSN
- 2073-4859 (ISSN-L)
- OpenAlex
- W2998668315
- Cited by
- 131
- References
- 42
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 19 · 2023: 31 · 2022: 17 · 2021: 19 · 2020: 13 · 2018: 1
- FWCI
- 5.58
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- The R Journal (publishedVersion, cc-by)
- Lincoln (University of Nebraska) (submittedVersion, cc-by)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, other-oa)
- OPUS (Augsburg University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (DFG‐PA 2409/3‐1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- repeated measures designs, longitudinal data, bootstrapping, permutation tests, multivariate normality, covariance structure, R package, graphical user interface, confidence intervals, p-value estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
