The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
A Crash Course in Good and Bad Controls
Abstract
Many students of statistics and econometrics express frustration with the way a problem known as “bad control” is treated in the traditional literature. The issue arises when the addition of a variable to a regression equation produces an unintended discrepancy between the regression coefficient and the effect that the coefficient is intended to represent. Avoiding such discrepancies presents a challenge to all analysts in the data intensive sciences. This note describes graphical tools for understanding, visualizing, and resolving the problem through a series of illustrative examples. By making this “crash course” accessible to instructors and practitioners, we hope to avail these tools to a broader community of scientists concerned with the causal interpretation of regression models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, covariates such as area of interest do not act as confounders but AOIs should still be included to improve the precision of the effect estimation by accounting for systematic variation across code segments [31].”
From Same Scrutiny, More Time: Eye Tracking Insights into Reviewing LLM-Labelled Code (2026) · cites this paper as [31]
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Self-citationMostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728 · cited 1×
“…elds, such as sociology (Elwert, 2013; Morgan and Winship, 2015), economics (Hünermund and Bareinboim, 2019; Cunningham, 2021), psychology (Rohrer, 2018), epidemiology (Greenland, Pearl and Robins, 1999; Hernán and Robins, 2020) and statistics (Pearl et al., 2009; Pearl, Glymour and Jewell, 2016).”
Self-citationCausal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355 · cited 7×
“More generally, the do -calculus provides a complete solution for the task of non-parametric identi fi cation of treatment effects in causal DAGs, beyond the simple adjustment formula (Pearl, 1995; Shpitser and Pearl, 2008; Pearl, 2009a).”
InfluentialSelf-citationCausal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336 · cited 6×
“More generally, the do -calculus provides a complete solution for the task of non-parametric identi fi cation of treatment effects in causal DAGs, beyond the simple adjustment formula (Pearl, 1995; Shpitser and Pearl, 2008; Pearl, 2009a).”
InfluentialSelf-citationEndogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168 · cited 1×
“Homophily bias in social network analysis (Elwert and Winship, 2014).”
Making sense of sensitivity: extending omitted variable bias
Cinelli, C., & Hazlett, C. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12348 · Cited by 1,088 · cited 3×
“In this case, progress can be made with sensitivity analyses, by, for instance, positing plausible bounds on the the strength of the direct effect of Z on Y , or on the strength of the effects of the latent variables (Cinelli et al., 2019; Cinelli and Hazlett, 2020a).”
Self-citation
Research works printed but not linked: 56
- Angrist J. D., 2014, Mastering ’metrics: The Path From Cause to Effect
- 10.1016/B978-1-55860-332-5.50011-0 · DOI · Paper page
- 10.1080/01621459.1997.10474074 · DOI · Paper page
- 10.1097/EDE.0b013e31828c776c · DOI
- 10.1073/pnas.1510507113 · DOI · Paper page
- 10.1093/jas/sky277 · DOI
- 10.3386/t0343 · DOI · Paper page
- 10.1007/978-94-007-6094-3_15 · DOI · Paper page
- Bowden R. J., 1990, Instrumental Variables
- 10.1093/esr/jcy037 · DOI
- Brito C., Pearl J. 2002. “Generalized instrumental variables”. In Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence , pages 85–93. Morgan Kaufmann Publishers Inc.
- Chen B., 2013, Real-World Economics Review
- Chernozhukov V., Cinelli C., Newey W., Sharma A., Syrgkanis V. 2021. “Omitted variable bias in machine learned causal models.” arXiv preprint arXiv:2112.13398. · arXiv
- 10.2139/ssrn.3588978 · DOI
- Cinelli C., Work. Pap
- Cinelli C., 2019, International Conference on Machine Learning
- Cramér H, 1946, Mathematical Methods of Statistics
- 10.1515/jci-2013-0021 · DOI
- 10.1007/978-94-007-6094-3_13 · DOI · Paper page
- 10.1097/ALN.0000000000003193 · DOI
- 10.1038/s41467-020-19478-2 · DOI · Paper page
- 10.1162/003465304323023688 · DOI
- 10.1111/rssb.12451 · DOI
- Hernán M., 2020, Causal Inference: What If
- 10.1093/aje/kwj275 · DOI · Paper page
- Hünermund P., Bareinboim E. 2019. “Causal inference and data-fusion in econometrics.” arXiv preprint arXiv:1912.09104 . · arXiv
- 10.18637/jss.v047.i11 · DOI · Paper page
- Kuroki M., Cai Z. 2004. “Selection of identifiability criteria for total effects by using path diagrams.” In Proceedings of the Conference on Uncertainty in Artificial Intelligence , pages 333–340.
- 10.1111/1467-9868.00381 · DOI
- 10.1093/pan/mpw015 · DOI
- Morgan S. L., 2015, Counterfactuals and Causal Inference
- Pearl J. 2010. On a class of bias-amplifying variables that endanger effect estimates. In Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence , pages 417–424. URL: https://ucla.in/2N8mBMg.
- 10.1093/aje/kwr352 · DOI · Paper page
- 10.1515/jci-2015-0004 · DOI
- Pearl J., 2016, Causal Inference in Statistics: a Primer
- Pearl J., 2018, The Book of Why: The New Science of Cause and Effect
- Perkovic E., 2018, Journal of Machine Learning Research, 18
- 10.2307/2981697 · DOI · Paper page
- 10.1007/978-1-4757-3692-2 · DOI · Paper page
- Rotnitzky A., 2020, Journal of Machine Learning Research, 21, 1
- 10.1016/j.eeh.2020.101356 · DOI
- Shpitser I., 2008, Journal of Machine Learning Research, 9, 1941
- Shpitser I., VanderWeele T., Robins J. M. 2012. On the validity of covariate adjustment for estimating causal effects. arXiv preprint arXiv:1203.3515 . · arXiv
- 10.1002/sim.3554 · DOI
- 10.1002/sim.3532 · DOI
- 10.1515/jci-2016-0009 · DOI
- Textor J., 2016, International journal of epidemiology, 45, 1887
- Thompson C. 2019. Causal graph analysis with the causalgraph procedure. In Proceedings of SAS Global Forum .
- 10.18637/jss.v076.i12 · DOI
- 10.1162/REST_a_00153 · DOI
- Witte J., 2020, Journal of Machine Learning Research, 21, 246
- 10.1017/S0266466605050516 · DOI
- Wooldridge J. M, 2010, Econometric Analysis of Cross Section and Panel Data
- Wright P. G, 1928, Tariff on Animal and Vegetable Oils
- Wright S, 1921, Journal of agricultural research, 20, 557
- Zhang C., Cinelli C., Chen B., Pearl J. 2021. Exploiting equality constraints in causal inference. In International Conference on Artificial Intelligence and Statistics , pages 1630–1638. PMLR.
Cited by
Causal machine learning for predicting treatment outcomes
Feuerriegel, S., Frauen, D., Melnychuk, V., Schweisthal, J., Hess, K., Curth, A., Bauer, S., Kilbertus, N., Kohane, I. S., & van der Schaar, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-02902-1 · Cited by 343
Wu, Y., & Huang, S. (2022) · Energy Economics · doi:10.1016/j.eneco.2022.106158 · Cited by 313
D’ya Like DAGs? A Survey on Structure Learning and Causal Discovery
Vowels, M. J., Camgoz, N. C., & Bowden, R. (2023) · ACM Computing Surveys · doi:10.1145/3527154 · Cited by 237
Lu, F. S., Nguyen, A. T., Link, N. B., Davis, J. T., Chinazzi, M., Xiong, X., Vespignani, A., Lipsitch, M., & Santillana, M. (2020) · doi:10.1101/2020.04.18.20070821 · Cited by 87
High-throughput target trial emulation for Alzheimer’s disease drug repurposing with real-world data
Zang, C., Zhang, H., Xu, J., Zhang, H., Fouladvand, S., Havaldar, S., Cheng, F., Chen, K., Chen, Y., Glicksberg, B. S., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-43929-1 · Cited by 69
Metadata
- Authors
- Cinelli, C., Forney, A., & Pearl, J.
- Affiliations
- Department of Statistics, University of Washington, Seattle
- Department of Computer Science, Loyola Marymount University, Los Angeles
- Department of Computer Science, University of California, Los Angeles
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2022-05-20
- Volume
- 53
- Issue
- 3
- Pages
- 1071-1104
- ISSN
- 0049-1241
- 1552-8294
- Cited by
- 490
- References
- 17
- Language
- en
- Funders
- Toyota Research Institute of North America (PO000897)
- National Science Foundation (#IIS-2106908)
- Office of Naval Research (#N00014-17-S-1209, #N00014-21-1-235)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Crash Course in Good and Bad Controls. https://app.cochat.ai/papers/10.1177/00491241221099552
- The paper
- Cinelli, C., Forney, A., & Pearl, J. (2024). A Crash Course in Good and Bad Controls. Sociological Methods & Research. https://doi.org/10.1177/00491241221099552
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.