Extending multivariate distance matrix regression with an effect size measure and the asymptotic null distribution of the test statistic
Open accessAbstract
Person-centered methods are useful for studying individual differences in terms of (dis)similarities between response profiles on multivariate outcomes. Multivariate distance matrix regression (MDMR) tests the significance of associations of response profile (dis)similarities and a set of predictors using permutation tests. This paper extends MDMR by deriving and empirically validating the asymptotic null distribution of its test statistic, and by proposing an effect size for individual outcome variables, which is shown to recover true associations. These extensions alleviate the computational burden of permutation tests currently used in MDMR and render more informative results, thus making MDMR accessible to new research domains.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500 · see citing works
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828 · see citing works
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · see citing works
Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis
Kruskal, J. B. (1964) · Psychometrika · doi:10.1007/bf02289565 · Cited by 7,270 · see citing works
THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL
Clopper, C. J., & Pearson, E. S. (1934) · Biometrika · doi:10.1093/biomet/26.4.404 · Cited by 5,106 · see citing works
Hierarchical Clustering Schemes
Johnson, S. C. (1967) · Psychometrika · doi:10.1007/bf02289588 · Cited by 4,948 · see citing works
Nonmetric Multidimensional Scaling: A Numerical Method
Kruskal, J. B. (1964) · Psychometrika · doi:10.1007/bf02289694 · Cited by 4,836 · see citing works
Some Distance Properties of Latent Root and Vector Methods Used in Multivariate Analysis
Gower, J. C. (1966) · Biometrika · doi:10.1093/biomet/53.3-4.325 · Cited by 4,274 · see citing works
FITTING MULTIVARIATE MODELS TO COMMUNITY DATA: A COMMENT ON DISTANCE-BASED REDUNDANCY ANALYSIS
McArdle, B. H., & Anderson, M. J. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[0290:fmmtcd]2.0.co;2 · Cited by 4,001 · see citing works
An Introduction to the Bootstrap.
Buckland, S. T., Efron, B., & Tibshirani, R. J. (1994) · Biometrics · doi:10.2307/2532810 · Cited by 3,236 · see citing works
Muthén, B., & Muthén, L. K. (2000) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2000.tb02070.x · Cited by 3,161 · see citing works
McCrae, R. R., & Costa, P. T. (2010) · Medical Entomology and Zoology · Cited by 2,345 · see citing works
Multidimensional Scaling: I. Theory and Method
Torgerson, W. S. (1952) · Psychometrika · doi:10.1007/bf02288916 · Cited by 2,167 · see citing works
Anderson, M. J., & Walsh, D. C. I. (2013) · Ecological Monographs · doi:10.1890/12-2010.1 · Cited by 2,025 · see citing works
A person-oriented approach in research on developmental psychopathology
Bergman, L. R., & Magnusson, D. (1997) · Development and Psychopathology · doi:10.1017/s095457949700206x · Cited by 1,318 · see citing works
Investigating population heterogeneity with factor mixture models.
Lubke, G. H., & Muthén, B. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.1.21 · Cited by 1,148 · see citing works
Self-citationDiet dominates host genotype in shaping the murine gut microbiota
Carmody, R. N., Gerber, G. K., Luevano, J. M., Gatti, D. M., Somes, L., Svenson, K. L., & Turnbaugh, P. J. (2015) · Cell Host & Microbe · doi:10.1016/j.chom.2014.11.010 · Cited by 1,103 · see citing works
Structural Equation Modeling of Mediation and Moderation With Contextual Factors
Little, T., Card, N. A., Bovaird, J., Preacher, K. J., & Crandall, C. (2007) · Routledge eBooks · doi:10.4324/9780203936825 · Cited by 523 · see citing works
Multivariate Analysis of Variance
Bray, J., & Maxwell, S. E. (1985) · Sage eBooks · doi:10.4135/9781412985222 · Cited by 471 · see citing works
Power and sample-size estimation for microbiome studies using pairwise distances and PERMANOVA
Kelly, B. J., Gross, R., Bittinger, K. L., Sherrill-Mix, S. A., Lewis, J. D., Collman, R. G., Bushman, F. D., & Li, H. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv183 · Cited by 456 · see citing works
Multidimensional Scaling of Similarity
Torgerson, W. S. (1965) · Psychometrika · doi:10.1007/bf02289530 · Cited by 424 · see citing works
Clustering Objects on Subsets of Attributes (with Discussion)
Friedman, J. H., & Meulman, J. J. (2004) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2004.02059.x · Cited by 422 · see citing works
Moving toward System Genetics through Multiple Trait Analysis in Genome-Wide Association Studies
Shriner, D. (2012) · Frontiers in Genetics · doi:10.3389/fgene.2012.00001 · Cited by 390 · see citing works
MEASUREMENT OF PHYSICAL HEALTH IN A GENERAL POPULATION SURVEY1
Belloc, N. B., Breslow, L., & Hochstim, J. R. (1971) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a121265 · Cited by 259 · see citing works
Multivariate Analysis of Variance
Harlow, L. L. (2014) · Routledge eBooks · doi:10.4324/9781315832746-16 · Cited by 243 · see citing works
Duchesne, P., & de Micheaux, P. L. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.11.025 · Cited by 218 · see citing works
The Structure of Posttraumatic Stress Disorder
Breslau, N., Reboussin, B. A., Anthony, J. C., & Storr, C. L. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.12.1343 · Cited by 216 · see citing works
A multivariate distance-based analytic framework for connectome-wide association studies
Shehzad, Z. E., Kelly, C. A. M., Reiss, P. T., Craddock, R. C., Emerson, J. W., McMahon, K. L., Copland, D. A., Castellanos, F. X., & Milham, M. P. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.02.024 · Cited by 178 · see citing works
A General Approach to Nonlinear Factor Analysis
McDonald, R. P. (1962) · Psychometrika · doi:10.1007/bf02289646 · Cited by 115 · see citing works
Connectome-wide network analysis of youth with Psychosis-Spectrum symptoms
Satterthwaite, T. D., Vandekar, S., Wolf, D. H., Bassett, D. S., Ruparel, K., Shehzad, Z. E., Craddock, R. C., Shinohara, R. T., Moore, T. M., Gennatas, E. D., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2015.66 · Cited by 114 · see citing works
Nonlinear Factor Analysis as a Statistical Method
Amemiya, Y., & Yalcin, I. (2001) · Statistical Science · doi:10.1214/ss/1009213729 · Cited by 103 · see citing works
The Integration of Multidimensional Scaling and Multivariate Analysis with Optimal Transformations
Meulman, J. J. (1992) · Psychometrika · doi:10.1007/bf02294419 · Cited by 103 · see citing works
Osborne, D., & Weiner, B. L. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.05.007 · Cited by 78 · see citing works
A Second Generation Nonlinear Factor Analysis
Etezadi-Amoli, J., & McDonald, R. P. (1983) · Psychometrika · doi:10.1007/bf02293678 · Cited by 76 · see citing works
Braeckman, U., Colen, C. V., Soetaert, K., et al. (2010) · Marine Ecology Progress Series · doi:10.3354/meps08910 · Cited by 73 · see citing works
Statistical Properties of Multivariate Distance Matrix Regression for High-Dimensional Data Analysis
Zapala, M. A., & Schork, N. J. (2012) · Frontiers in Genetics · doi:10.3389/fgene.2012.00190 · Cited by 73 · see citing works
Bernstein, A., Stickle, T. R., Zvolensky, M. J., Taylor, S., Abramowitz, J., & Stewart, S. (2010) · The Behavior Therapist · doi:10.1016/j.beth.2010.02.003 · Cited by 67 · see citing works
Using factor mixture modeling to identify dimensions of cognitive test anxiety
Cassady, J. C., & Finch, W. H. (2015) · Learning and Individual Differences · doi:10.1016/j.lindif.2015.06.002 · Cited by 57 · see citing works
3D visualization of the regional differences
Ellegood, J., Anagnostou, E. A., Babineau, B. A., Crawley, J. N., Lin, L., Genestine, M., DiCicco-Bloom, E. M., Lai, J., Foster, J. A., Peñagarikano, O., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.168 · Cited by 52 · see citing works
Trait Stress Resistance and Dynamic Stress Dissipation on Health and Well-Being: The Reservoir Model
Bergeman, C. S., & Deboeck, P. R. (2014) · Research in Human Development · doi:10.1080/15427609.2014.906736 · Cited by 31 · see citing works
Self-citationSimultaneous Classification and Multidimensional Scaling with External Information
Kiers, H. A. L., Vicari, D., & Vichi, M. (2005) · Psychometrika · doi:10.1007/s11336-002-0998-4 · Cited by 14 · see citing works
Kubarych, T. S., Aggen, S. H., Kendler, K. S., et al. (2010) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.318 · Cited by 12 · see citing works
Salem, R. M., O’Connor, D. T., & Schork, N. J. (2010) · Physiological Genomics · doi:10.1152/physiolgenomics.00118.2009 · Cited by 7 · see citing works
Multivariate Genetic Analyses in Heterogeneous Populations
Lubke, G. H., & McArtor, D. B. (2013) · Behavior Genetics · doi:10.1007/s10519-013-9631-9 · Cited by 7 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- Davies RB 1980 The distribution of a linear combination of chi-square random variables Journal of the Royal Statistical Society 29 323 333
- Friedman JH Meulman JJ 2004 Clustering objects on subsets of attributes Journal of the Royal Statistical Society 66 815 839
Cited by
Sorted by citations
Association of Prenatal Maternal Anxiety With Fetal Regional Brain Connectivity
De Asis-Cruz, J., Krishnamurthy, D., Zhao, L., Kapse, K., Vezina, G., Andescavage, N., Quistorff, J., Lopez, C., & Limperopoulos, C. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.22349 · Cited by 81 · see citing works
Similarity-based multimodal regression
Chen, A. A., Weinstein, S. M., Adebimpe, A., Gur, R. C., Gur, R. E., Merikangas, K. R., Satterthwaite, T. D., Shinohara, R. T., & Shou, H. (2024) · Biostatistics · doi:10.1093/biostatistics/kxad033 · Cited by 6 · see citing works
- Authors
- McArtor, D. B., Lubke, G. H., & Bergeman, C. S.
- Affiliations
- University of Notre Dame (US)
- Corresponding author
- McArtor, Daniel B.
- Venue
- Psychometrika
- Publisher
- Cambridge University Press (CUP)
- Published
- 2017-12
- Volume
- 82
- Issue
- 4
- Pages
- 1052-1077
- ISSN
- 0033-3123 (ISSN-L)
- 1860-0980
- PMC
- PMC5624863
- OpenAlex
- W2531272587
- Cited by
- 71
- References
- 45
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 5 · 2023: 12 · 2022: 13 · 2021: 13 · 2020: 3 · 2019: 6 · 2018: 6 · 2017: 1
- FWCI
- 4.72
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Psychometrika (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- VU Research Portal (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- National Institute on Drug Abuse (NIDA-DA018673)
- National Institute on Aging (1 R01 AG023571-A1-01)
- National Science Foundation (NSF MRI BCS-1229450)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Keywords
- individual differences, effect size, asymptotic null distribution, permutation tests, computational efficiency, multivariate outcomes
- MeSH terms
- Computer Simulation, Cross-Sectional Studies, Data Interpretation, Statistical, Humans, Monte Carlo Method, Personality Tests, Probability, Regression Analysis, ROC Curve, Multivariate Analysis, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review