The DOI matches its Crossref record; 124 of the 124 references it cites were found in a registry or an index.
Causal Inference by using Invariant Prediction: Identification and Confidence Intervals
Open accessAbstract
Summary: What is the difference between a prediction that is made with a causal model and that with a non-causal model? Suppose that we intervene on the predictor variables or change the whole environment. The predictions from a causal model will in general work as well under interventions as for observational data. In contrast, predictions from a non-causal model can potentially be very wrong if we actively intervene on variables. Here, we propose to exploit this invariance of a prediction under a causal model for causal inference: given different experimental settings (e.g. various interventions) we collect all models that do show invariance in their predictive accuracy across settings and interventions. The causal model will be a member of this set of models with high probability. This approach yields valid confidence intervals for the causal relationships in quite general scenarios. We examine the example of structural equation models in more detail and provide sufficient assumptions under which the set of causal predictors becomes identifiable. We further investigate robustness properties of our approach under model misspecification and discuss possible extensions. The empirical properties are studied for various data sets, including large-scale gene perturbation experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Tests of Equality Between Sets of Coefficients in Two Linear Regressions
Chow, G. C. (1960) · Econometrica · doi:10.2307/1910133 · Cited by 6,488
"General Intelligence," Objectively Determined and Measured
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412107 · Cited by 6,207
Research works printed but not linked: 42
- Castelo, 2003, On inclusion-driven learning of Bayesian networks, J. Mach. Learn. Res., 4, 527
- Chickering, 2002, Optimal structure identification with greedy search, J. Mach. Learn. Res., 3, 507
- Cooper, 1999, Proc. 15th A. Conf. Uncertainty in Artificial Intelligence, 116
- Didelez, 2006, Proc. 22nd A. Conf. Uncertainty in Artifical Intelligence, 138
- Durot, 2013, Testing equality of functions under monotonicity constraints, J. Nonparam. Statist., 25, 939, 10.1080/10485252.2013.826356 · doi:10.1080/10485252.2013.826356
- Eaton, 2007, Proc. 11th Int. Conf. Artificial Intelligence and Statistics, 107
- Hothorn, 2010, Model-based boosting 2.0, 11, 2109
- Richardson, 2013, Single world intervention graphs (SWIGs): a unification of the counterfactual and graphical approaches to causality
- Rothenhäusler, 2015, Advances in Neural Information Processing Systems
- Schölkopf, 2012, Proc. 29th Int. Conf. Machine Learning, 1255
- Tian, 2001, Proc. 17th A. Conf. Uncertainty in Artificial Intelligence, 512
- Verma, 1991, Proc. 6th A. Conf. Uncertainty in Artificial Intelligence, 255
- Wright, 1928, The Tariff on Animal and Vegetable Oils
- Acid, 1996, Proc. 12th A. Conf. Uncertainty in Artificial Intelligence, 3
- Aldrich, 1989, Autonomy, Oxf. Econ. Pap., 41, 15, 10.1093/oxfordjournals.oep.a041889 · DOI
- Bollen, 1989, Structural Equations with Latent Variables, 10.1002/9781118619179 · DOI · Paper page
- Colombo, 2012, Learning high-dimensional directed acyclic graphs with latent and selection variables, Ann. Statist., 40, 294, 10.1214/11-AOS940 · DOI · Paper page
- Dawid, 2000, Causal inference without counterfactuals (with discussion), J. Am. Statist. Ass., 95, 407, 10.1080/01621459.2000.10474210 · DOI · Paper page
- Dawid, 2015, Statistical causality from a decision-theoretic perspective, A. Rev. Statist. Appl., 2, 273, 10.1146/annurev-statistics-010814-020105 · DOI
- Dawid, 2010, Identifying the consequences of dynamic treatment strategies: a decision-theoretic overview, Statist. Surv., 4, 184, 10.1214/10-SS081 · DOI
- Diebold, 2001, Elements of Forecasting, 254
- Eckardt, 2016, Point patterns occurring on complex structures in space and space-time: an alternative network approach
- Encyclopedia Britannica, 2014, Encyclopedia Britannica
- Finkenstädt, 2013, Quantifying intrinsic and extrinsic noise in gene transcription using the linear noise approximation: an application to single cell data, Ann. Appl. Statist., 7, 1960, 10.1214/13-AOAS669 · DOI
- van de Geer, 2014, On asymptotically optimal confidence regions and tests for high-dimensional models, Ann. Statist., 42, 1166, 10.1214/14-AOS1221 · DOI · Paper page
- Haavelmo, 1995, The Foundations of Econometric Analysis, 440, 10.1017/CBO9781139170116.042 · doi:10.1017/cbo9781139170116.042
- Hernán, 2016, Causal Inference
- Hoefer, 2016, The Stanford Encyclopedia of Philosophy
- Hora, 1967, Fiducial theory and invariant prediction, Ann. Math. Statist., 38, 795, 10.1214/aoms/1177698873 · doi:10.1214/aoms/1177698873
- Hoyer, 2009, Advances in Neural information Processing Systems, 689
- Hu, 2016, Analysis of air quality time series of Hong Kong with graphical modeling, Environmetrics, 27, 169, 10.1002/env.2386 · doi:10.1002/env.2386
- Kemmeren, 2014, Large-scale genetic perturbations reveal regulatory networks and an abundance of gene-specific repressors, Cell, 157, 740, 10.1016/j.cell.2014.02.054 · DOI · Paper page
- Luo, 2011, Bayesian hierarchical modeling for signaling pathway inference from single cell interventional data, Ann. Appl. Statist., 5, 725, 10.1214/10-AOAS425 · doi:10.1214/10-aoas425
- Obenchein, 1971, Multivariate procedures invariant under linear transformations, Ann. Math. Statist., 42, 1569, 10.1214/aoms/1177693155 · doi:10.1214/aoms/1177693155
- Peters, 2015, Causal inference using invariant prediction: identification and confidence intervals
- Richardson, 1996, Proc. 12th A. Conf. Uncertainty in Artificial Intelligence, 454
- Richardson, 2002, Ancestral graph Markov models, Ann. Statist., 30, 962, 10.1214/aos/1031689015 · DOI · Paper page
- Rothenhäusler, 2015, Advances in Neural Information Processing Systems, 1513
- Shimizu, 2006, A linear non-Gaussian acyclic model for causal discovery, J. Mach. Learn. Res., 7, 2003
- Spirtes, 2000, Causation, Prediction and Search
- Wikipedia, 2016, Wikipedia
- Zhu, 2004, Causal linkages among Shanghai, Shenzhen, and Hong Kong stock markets, Int. J. Theoret. Appl. Finan., 7, 135, 10.1142/S0219024904002414 · doi:10.1142/s0219024904002414
Cited by
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Toward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170
Inferring causation from time series in Earth system sciences
Runge, J., Bathiany, S., Bollt, E., Camps-Valls, G., Coumou, D., Deyle, E., Glymour, C., Kretschmer, M., Mahecha, M. D., Muñoz-Marí, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-10105-3 · Cited by 984
Self-citationArjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927
Causal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459
Causal network reconstruction from time series: From theoretical assumptions to practical estimation
Runge, J. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5025050 · Cited by 422
Out-of-Distribution Generalization via Risk Extrapolation (REx)
Krueger, D., Caballero, E., Jacobsen, J.-H., Zhang, A., Binas, J., Zhang, D., Priol, R. L., & Courville, A. (2020) · arXiv · doi:10.48550/arxiv.2003.00688 · Cited by 407
Underspecification Presents Challenges for Credibility in Modern Machine Learning
D'Amour, A., Heller, K., Moldovan, D., Adlam, B., Alipanahi, B., Beutel, A., Chen, C., Deaton, J., Eisenstein, J., Hoffman, M. D., et al. (2020) · arXiv · doi:10.48550/arxiv.2011.03395 · Cited by 398
A Survey of Learning Causality with Data: Problems and Methods
Guo, R., Cheng, L., Li, J., Hahn, P. R., & Liu, H. (2021) · ACM Computing Surveys · doi:10.1145/3397269 · Cited by 362
Sagawa, S., Koh, P. W., Hashimoto, T., & Liang, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08731 · Cited by 331
The three major axes of terrestrial ecosystem function
Migliavacca, M., Musavi, T., Mahecha, M. D., Nelson, J. A., Knauer, J., Baldocchi, D. D., Perez-Priego, O., Christiansen, R., Peters, J., Anderson, K., et al. (2021) · Nature · doi:10.1038/s41586-021-03939-9 · Cited by 299
Self-citationCausal inference for time series
Runge, J., Gerhardus, A., Varando, G., Eyring, V., & Camps-Valls, G. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00431-y · Cited by 288
WILDS: A Benchmark of in-the-Wild Distribution Shifts
Koh, P. W., Sagawa, S., Marklund, H., Xie, S. M., Zhang, M., Balsubramani, A., Hu, W., Yasunaga, M., Phillips, R. L., Gao, I., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07421 · Cited by 518
“This builds on earlier work on invariant predictors (Peters et al., 2016).”
Towards Out-Of-Distribution Generalization: A Survey
Liu, J., Shen, Z., He, Y., Zhang, X., Xu, R., Yu, H., & Cui, P. (2021) · arXiv · doi:10.48550/arxiv.2108.13624 · Cited by 253
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00511 · Cited by 220
Conformal Inference of Counterfactuals and Individual Treatment Effects
Lei, L., & Candès, E. J. (2021) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12445 · Cited by 166
Methods for causal inference from gene perturbation experiments and validation
Meinshausen, N., Hauser, A., Mooij, J. M., Peters, J., Versteeg, P., & Bühlmann, P. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510493113 · Cited by 140
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
Causal discovery and the problem of psychological interventions
Eronen, M. I. (2020) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2020.100785 · Cited by 102
For and Against Methodologies: Some Perspectives on Recent Causal and Statistical Inference Debates
Greenland, S. (2017) · European Journal of Epidemiology · doi:10.1007/s10654-017-0230-6 · Cited by 86
In Search of Lost Domain Generalization
Gulrajani, I., & Lopez-Paz, D. (2020) · arXiv · doi:10.48550/arxiv.2007.01434 · Cited by 440
“The causality literature refers to domain generalization as learning from multiple environments [Peters et al., 2016, Arjovsky et al., 2019].”
BackgroundCausal inference on human behaviour
Bailey, D. H., Jung, A. J., Beltz, A. M., Eronen, M. I., Gische, C., Hamaker, E. L., Kording, K. P., Lebel, C., Lindquist, M. A., Moeller, J., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01939-z · Cited by 56
Understanding the Failure Modes of Out-of-Distribution Generalization
Nagarajan, V., Andreassen, A., & Neyshabur, B. (2020) · arXiv · doi:10.48550/arxiv.2010.15775 · Cited by 55
Goals in Nutrition Science 2015–2020
Allison, D. B., Bassaganya-Riera, J., Burlingame, B., Brown, A. W., le Coutre, J., Dickson, S. L., van Eden, W., Garssen, J., Hontecillas, R., Khoo, C. S. H., et al. (2015) · Frontiers in Nutrition · doi:10.3389/fnut.2015.00026 · Cited by 45
“” Recent attempts to develop methods that enable to provide a degree of causal evidence are very encouraging and can allow us to maximize the potential of “big data” (57, 58).”
Statistical quantification of confounding bias in machine learning models
Spisak, T. (2022) · GigaScience · doi:10.1093/gigascience/giac082 · Cited by 34
Zhou, F., Mao, Y., Yu, L., Yang, Y., & Zhong, T. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.232 · Cited by 29
An Investigation of Critical Issues in Bias Mitigation Techniques
Shrestha, R., Kafle, K., & Kanan, C. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00257 · Cited by 22
Causal Learning for Socially Responsible AI
Cheng, L., Mosallanezhad, A., Sheth, P., & Liu, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/598 · Cited by 15
Automated Scientific Discovery: From Equation Discovery to Autonomous Discovery Systems
Kramer, S., Cerrato, M., Brugger, J., Džeroski, S., & King, R. (2023) · arXiv · doi:10.48550/arxiv.2305.02251 · Cited by 10
Metadata
- Authors
- Peters, J., Bühlmann, P., & Meinshausen, N.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-10-11
- Volume
- 78
- Issue
- 5
- Pages
- 947-1012
- ISSN
- 1369-7412
- 1467-9868
- OpenAlex
- W2790376986
- Cited by
- 643
- References
- 124
- Type
- other
- Language
- en
- Open access
- green
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Funders
- European Union's seventh framework programme (FP7/2007–2013)
- Research Executive Agency (326496)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.