Assessing spurious "moderator effects": Illustrated substantively with the hypothesized ("synergistic") relation between spatial and mathematical ability.

Lubinski, David, Humphreys, Lloyd G.·1990·Psychological Bulletin

Abstract

The traditional methodology for assessing moderator variables (hierarchical multiple regression analysis) is examined. Possible drawbacks of this technique for corroborating psychological theories (cf. Busemeyer & Jones, 1983), are illustrated empirically on the basis of an analysis of 400,000 subjects. This article tested a well-known (and currently popular) substantive hypothesis: A synergistic relation exists between mathematical ability and spatial visualization in the prediction and development of sophisticated levels of advanced mathematics. Using the traditional methodology, this hypothesis was confirmed; however, on further analysis, using a more systematic approach, it was demonstrated that this finding was spurious. Suggestions are offered for modifying the traditional methodology used for assessing moderator effects (for both applied and theoretical purposes). These amount to ways for minimizing Type I and Type II errors.

Cited by (24)

  1. Testing moderator and mediator effects in counseling psychology research.
    Frazier, Patricia A., Tix, Andrew P., Barron, Kenneth E. · 2004 · Journal of Counseling Psychology
  2. Statistical difficulties of detecting interactions and moderator effects.
    McClelland, Gary H., Judd, Charles M. · 1993 · Psychological Bulletin
  3. Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance.
    Wai, Jonathan, Lubinski, David, Benbow, Camilla P. · 2009 · Journal of Educational Psychology
  4. Quantifying and Testing Indirect Effects in Simple Mediation Models When the Constituent Paths Are Nonlinear
    Hayes, Andrew F., Preacher, Kristopher J. · 2010 · Multivariate Behavioral Research
  5. Bivariate median splits and spurious statistical significance.
    Scott E. Maxwell, Harold D. Delaney · 1993 · Psychological Bulletin

See all 336

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assessing spurious "moderator effects": Illustrated substantively with the hypothesized ("synergistic") relation between spatial and mathematical ability. https://app.cochat.ai/papers/10.1037//0033-2909.107.3.385
The paper
Lubinski, D., & Humphreys, L. G. (1990). Assessing spurious "moderator effects": Illustrated substantively with the hypothesized ("synergistic") relation between spatial and mathematical ability. Psychological Bulletin. https://doi.org/10.1037//0033-2909.107.3.385

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.