To Adjust or Not to Adjust? Sensitivity Analysis of M -Bias and Butterfly-Bias
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
“ M -Bias,” as it is called in the epidemiologic literature, is the bias introduced by conditioning on a pretreatment covariate due to a particular “ M -Structure” between two latent factors, an observed treatment, an outcome, and a “collider.” This potential source of bias, which can occur even when the treatment and the outcome are not confounded, has been a source of considerable controversy. We here present formulae for identifying under which circumstances biases are inflated or reduced. In particular, we show that the magnitude of M -Bias in linear structural equation models tends to be relatively small compared to confounding bias, suggesting that it is generally not a serious concern in many applied settings. These theoretical results are consistent with recent empirical findings from simulation studies. We also generalize the M -Bias setting (1) to allow for the correlation between the latent factors to be nonzero and (2) to allow for the collider to be a confounder between the treatment and the outcome. These results demonstrate that mild deviations from the M -Structure tend to increase confounding bias more rapidly than M -Bias, suggesting that choosing to condition on any given covariate is generally the superior choice. As an application, we re-examine a controversial example between Professors Donald Rubin and Judea Pearl.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 2×
“The above can also be expressed in the potential outcomes framework [24, 25].”
BackgroundA structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 2×
“The hallmark of an observational study is selection bias (Heckman, 1979, Copas and Li, 1997, Hernán, Hernandez-Diaz, and Robins, 2004).”
BackgroundCausal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355 · cited 4×
“For a more technical overview, see Pearl (1995) or Pearl (2009a).”
BackgroundInfluentialLimitations of the Application of Fourfold Table Analysis to Hospital Data
Berkson, J. (1946) · Biometrics Bulletin · doi:10.2307/3002000 · Cited by 1,810 · cited 2×
“Given this, conditioning on M can cause a spurious correlation between U and W, which is known as the collider bias [15], or, in epidemiology, Berkson’s Paradox [16].”
BackgroundRubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831 · cited 2×
“…objective causal inference, Rubin and Rosenbaum suggest balancing all the pretreatment covariate in observational studies to parallel with the design of randomized experiments (Rubin, 2007, 2008, 2009, Rosenbaum, 2002), which is called the “pretreatment criterion” (VanderWeele and Shpitser, 2011).”
BackgroundMethodQuantifying Biases in Causal Models: Classical Confounding vs Collider-Stratification Bias
Greenland, S. (2003) · Epidemiology · doi:10.1097/01.ede.0000042804.12056.6c · Cited by 810 · cited 4×
“Previous qualitative analysis for binary variables shows that collider bias generally tends to be small (Greenland, 2002), and simulation studies (Liu, Brookhart, Schneeweiss, Mi, and Setoguchi, 2012) again demonstrate that M-Bias is small in many realistic settings.”
BackgroundInfluentialA New Criterion for Confounder Selection
VanderWeele, T. J., & Shpitser, I. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01619.x · Cited by 434
Linear Models: A Useful "Microscope" for Causal Analysis
Pearl, J. (2013) · Journal of Causal Inference · doi:10.1515/jci-2013-0003 · Cited by 132 · cited 6×
“Sprites (2002) uses linear models to illustrate M-Bias in observational studies, and Pearl (2013) also utilize the transparency of such linear models to examine various types of causal phenomena, biases, and paradoxes.”
BackgroundMethodInfluential
Cited by
Principles of confounder selection
VanderWeele, T. J. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00494-6 · Cited by 1,535
Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002
“Quite pragmatically, one can gauge which of the two biases is more problematic and then settle for the lesser evil (Ding & Miratrix, 2015).”
BackgroundMaking sense of sensitivity: extending omitted variable bias
Cinelli, C., & Hazlett, C. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12348 · Cited by 1,088
Collider bias undermines our understanding of COVID-19 disease risk and severity
Griffith, G. J., Morris, T. T., Tudball, M. J., Herbert, A., Mancano, G., Pike, L., Sharp, G. C., Sterne, J., Palmer, T. M., Davey Smith, G., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19478-2 · Cited by 826
Lederer, D. J., Bell, S. C., Branson, R. D., Chalmers, J. D., Marshall, R., Maslove, D. M., Ost, D. E., Punjabi, N. M., Schatz, M., Smyth, A. R., et al. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201808-564ps · Cited by 715
Metadata
- Authors
- Ding, P., & Miratrix, L. W.
- Venue
- Journal of Causal Inference
- Publisher
- Walter de Gruyter GmbH
- Published
- 2014-09-09
- Volume
- 3
- Issue
- 1
- Pages
- 41-57
- ISSN
- 2193-3677 (ISSN-L)
- 2193-3685
- OpenAlex
- W2962929144
- Cited by
- 126
- References
- 11
- FWCI
- 6.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: To Adjust or Not to Adjust? Sensitivity Analysis of M -Bias and Butterfly-Bias. https://app.cochat.ai/papers/10.1515/jci-2013-0021
- The paper
- Ding, P., & Miratrix, L. W. (2015). To Adjust or Not to Adjust? Sensitivity Analysis of M -Bias and Butterfly-Bias. Journal of Causal Inference. https://doi.org/10.1515/jci-2013-0021
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.