The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Methodological Urban Legends: The Misuse of Statistical Control Variables
Abstract
The automatic or blind inclusion of control variables in multiple regression and other analyses, intended to purify observed relationships among variables of interest, is widespread and can be considered an example of practice based on a methodological urban legend. Inclusion of such variables in most cases implicitly assumes that the control variables are somehow either contaminating the measurement of the variables of interest or affecting the underlying constructs, thus distorting observed relationships among them. There are, however, a number of alternative mechanisms that would produce the same statistical results, thus throwing into question whether inclusion of control variables has led to more or less accurate interpretation of results. The authors propose that researchers should be explicit rather than implicit regarding the role of control variables and match hypotheses precisely to both the choice of variables and the choice of analyses. The authors further propose that researchers avoid testing models in which demographic variables serve as proxies for variables that are of real theoretical interest in their data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, no correction for these variables was applied [68].”
From Adaptive working memory training does not produce transfer effects in cognition and neuroimaging (2022) · cites this paper as [68]
In the citing paper
“there is converging evidence that control variables should be used with caution (Spector and Brannick, 2011; Bernerth and Aguinis, 2016).”
From Race and Gender Differences in Undergraduate Research Mentoring Structures and Research Outcomes (2017) · cites this paper as Spector and Brannick, 2011
In the citing paper
“For model parsimony, and in accordance with guidelines from Spector and Brannick (2011) regarding the misuse of demographic variables as covariates, the final models did not include these demographic control variables.”
From Time Spent on Social Media and Associations with Mental Health in Young Adults: Examining TikTok, Twitter, Instagram, Facebook, Youtube, Snapchat, and Reddit (2025) · cites this paper as Spector and Brannick (2011)
In the citing paper
“Longitudinal designs provide stronger evidence, but are prone to residual confounding [[36], [37], [38]] and other forms of bias that limit causal inference [[39], [40], [41], [42], [43]].”
From Improving sleep quality leads to better mental health: A meta-analysis of randomised controlled trials (2021) · cites this paper as [37]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
(2002) · Cited by 13,211
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
(1982) · Cited by 3,737
Health complaints, stress, and distress: Exploring the central role of negative affectivity.
Watson, D., & Pennebaker, J. W. (1989) · Psychological Review · doi:10.1037/0033-295x.96.2.234 · Cited by 3,030
Becker, T. E. (2005) · Organizational Research Methods · doi:10.1177/1094428105278021 · Cited by 2,219
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793
Statistical Methods for Research Workers
(1926) · Journal of Comparative Pathology and Therapeutics · doi:10.1016/s0368-1742(26)80018-9 · Cited by 1,283
Work Process and Quality of Care in Early Childhood Education: The Role of Job Crafting
Leana, C., Appelbaum, E., & Shevchuk, I. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.47084651 · Cited by 726
Research works printed but not linked: 5
- Atinc, G., Paper presented at the Southern Management Association
- Meade, A.W., Behrend, T.S. & Lance, C.E. ( 2009). Dr. StrangeLOVE, or: How I learned to stop worrying and love omitted variables. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 89-106). New York, NY: Routledge/Taylor & Francis Group.
- Nunnally, J.C., 1994, Psychometric theory
- 10.1037/0882-7974.2.3.261 · doi:10.1037/0882-7974.2.3.261
- 10.1037/0021-9010.79.3.323 · doi:10.1037/0021-9010.79.3.323 · Paper page
Cited by
A Critical Review and Best‐Practice Recommendations for Control Variable Usage
Bernerth, J. B., & Aguinis, H. (2016) · Personnel Psychology · doi:10.1111/peps.12103 · Cited by 1,731
“As a result, there is a common albeit often unsubstantiated belief that the inclusion of control variables purifies results and uncovers “true” relationships (Atinc et al., 2012, p. 59; Carlson & Wu, 2012; Spector & Brannick, 2011).”
BackgroundResultInfluentialDo Not Cross Me: Optimizing the Use of Cross-Sectional Designs
Spector, P. E. (2019) · Journal of Business and Psychology · doi:10.1007/s10869-018-09613-8 · Cited by 1,366
“…correlations in metaanalyses do not uniformly find larger correlations from cross-sectional designs (e.g., Nixon, Mazzola, Bauer, Krueger, & Spector, 2011; Pindek & Spector, 2016), and even when cross-sectional correlations are larger, it is not necessarily due to common method variance.”
BackgroundSelf-citationPsychological Safety: A Meta‐Analytic Review and Extension
Frazier, M. L., Fainshmidt, S., Klinger, R. L., Pezeshkan, A., & Vracheva, V. (2017) · Personnel Psychology · doi:10.1111/peps.12183 · Cited by 1,231
Embracing Causal Complexity: The Emergence of a Neo-Configurational Perspective
Misangyi, V. F., Greckhamer, T., Furnari, S., Fiss, P. C., Crilly, D., & Aguilera, R. (2017) · Journal of Management · doi:10.1177/0149206316679252 · Cited by 1,099
Scott, A. J., Webb, T. L., Martyn-St James, M., Rowse, G., & Weich, S. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101556 · Cited by 1,094
Metadata
- Authors
- Spector, P. E., & Brannick, M. T.
- Affiliations
- University of South Florida (US)
- Department of Psychology, University of South Florida, Tampa, USA
- Corresponding author
- Spector, Paul E.
- ORCID
- Spector, Paul E.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2010-06-02
- Volume
- 14
- Issue
- 2
- Pages
- 287-305
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2001810891
- Cited by
- 1,146
- References
- 41
- Citations by year
- 2026: 111 · 2025: 89 · 2024: 64 · 2023: 103 · 2022: 101 · 2021: 89 · 2020: 89 · 2019: 80 · 2018: 81 · 2017: 70 · 2016: 72 · 2015: 55 · 2014: 58 · 2013: 40 · 2012: 26
- FWCI
- 21.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Digital Commons - University of South Florida (University of South Florida) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Keywords
- control variables, multiple linear regression, confounding, feature selection, statistical control, measurement contamination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodological Urban Legends: The Misuse of Statistical Control Variables. https://app.cochat.ai/papers/10.1177/1094428110369842
- The paper
- Spector, P. E., & Brannick, M. T. (2011). Methodological Urban Legends: The Misuse of Statistical Control Variables. Organizational Research Methods. https://doi.org/10.1177/1094428110369842
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.