Causal Deep Learning

Berrevoets, Jeroen; Kacprzyk, Krzysztof; Qian, Zhaozhi; van der Schaar, Mihaela

doi:10.48550/arxiv.2303.02186

PreprintCited by 8Bayesian Modeling and Causal InferenceAdvanced Causal Inference TechniquesExplainable Artificial Intelligence (XAI)

Causal Deep Learning

Open access

Berrevoets, Jeroen, Kacprzyk, Krzysztof, Qian, Zhaozhi, van der Schaar, Mihaela·2023·arXiv

DOI 10.48550/arxiv.2303.02186arXiv 2303.02186

Open this paper in CoChat — free account Open PDF

Abstract

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in practice. To address this challenge, we propose a new way of thinking about causality -- we call this causal deep learning. Our causal deep learning framework spans three dimensions: (1) a structural dimension, which incorporates partial yet testable causal knowledge rather than assuming either complete or no causal knowledge among the variables of interest; (2) a parametric dimension, which encompasses parametric forms that capture the type of relationships among the variables of interest; and (3) a temporal dimension, which captures exposure times or how the variables of interest interact (possibly causally) over time. Causal deep learning enables us to make progress on a variety of real-world problems by leveraging partial causal knowledge (including independencies among variables) and quantitatively characterising causal relationships among variables of interest (possibly over time). Our framework clearly identifies which assumptions are testable and which ones are not, such that the resulting solutions can be judiciously adopted in practice. Using our formulation we can combine or chain together causal representations to solve specific problems without losing track of which assumptions are required to build these solutions, pushing real-world impact in healthcare, economics and business, environmental sciences and education, through causal deep learning.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2303.02186

Cites

148 of 148 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Causality has recently enjoyed increasing attention again, with discussion about causality in deep learning and medical imaging.
“Nevertheless, causality has recently enjoyed increasing attention again, with discussion about causality in deep learning68 and medical imaging69,70.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [68]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 3× · see citing works
“s t r u c t u r e s parameters [53] [52] [54]”
Background
Deep Learning
Hao, X., Zhang, G., & Ma, S. (2016) · International Journal of Semantic Computing · doi:10.1142/s1793351x16500045 · Cited by 82,372
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1× · see citing works
“While research on bandits seem to provide algorithms which are agnostic to estimation, RL seems to stem more from a deep learning community; hence most papers in RL rely on neural networks to approximate the reward (based on, for example, Mnih et al. [173]).”
Background
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · cited 1× · see citing works
“With much less strict assumptions and based on the enormous ﬂexibility of deep learning models [6–8], CDL is uniquely positioned to provide solutions to these challenging settings [9].”
Background
Pattern classification and scene analysis
Grenander, U., Duda, R., & Hart, P. (1974) · A Wiley-Interscience publication · doi:10.2307/1573081 · Cited by 17,399 · see citing works
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824 · see citing works
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762 · cited 3× · see citing works
“Not only is time an essential component in causality (as causes precede eﬀects [11]), but time can also inﬂuence whether or not something is causal.”
BackgroundMethod
Causality
Rohs, P. (2019) · Mind and the Present · doi:10.7551/mitpress/11578.003.0012 · Cited by 4,013 · cited 2×
“These assumptions vary from: knowing the ground-truth causal graph [2], or assuming all relevant variables are present in the data which cannot be guaranteed [3, 4].”
BackgroundMethod
The Book of Why: The New Science of Cause and Effect
Frappier, M. (2018) · Science · doi:10.1126/science.aau9731 · Cited by 2,566 · cited 6×
“5” Pearl’s ladder of causation [1, 10] ranks structures in a similar way as we do, i.”
Influential
Equivalence and Synthesis of Causal Models
Verma, T., & Pearl, J. (1990) · Conference on Uncertainty in Artificial Intelligence · doi:10.1145/3501714.3501732 · Cited by 1,542 · cited 1× · see citing works
“Applying the rules of d-separation [62].”
Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment
Rubin, D. B. (1980) · Journal of the American Statistical Association · doi:10.2307/2287653 · Cited by 1,368 · see citing works
Toward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170 · cited 1× · see citing works
“Review papers (such as [50, 51]) are very useful for the community as they collect and frame an enormous amount of relevant papers, but they do not help us to deﬁne a clear research agenda as they never (a) provide a distinction between causality, deep learning, and causal deep learning as the…”
Background
Counterfactual Fairness
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995 · cited 1× · see citing works
“Other CDL techniques evaluate models post training using causal evaluation metrics [21].”
Method
Review of Causal Discovery Methods Based on Graphical Models
Glymour, C., Zhang, K., & Spirtes, P. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00524 · Cited by 861 · cited 1× · see citing works
“It is also long thought to be impossible [81–84].”
Background
Smoking and Mortality — Beyond Established Causes
Carter, B. D., Abnet, C. C., Feskanich, D., Freedman, N. D., Hartge, P., Lewis, C. E., Ockene, J. K., Prentice, R. L., Speizer, F. E., Thun, M. J., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmsa1407211 · Cited by 809 · see citing works
DirectLiNGAM: A Direct Method for Learning a Linear Non-Gaussian Structural Equation Model
Shimizu, S., Inazumi, T., Sogawa, Y., et al. (2011) · Journal of machine learning research · doi:10.5555/1953048.2021040 · Cited by 716
Introduction to Linear Regression Analysis
Porter, D. R., Montgomery, D., & Peck, E. A. (2007) · Technometrics · doi:10.1198/tech.2007.s499 · Cited by 617 · cited 2× · see citing works
“s t r u c t u r e s parameters [53] [52] [54]”
Background
Parameter estimation for differential equations: a generalized smoothing approach
Ramsay, J. O., Hooker, G., Campbell, D., & Cao, J. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00610.x · Cited by 613 · see citing works
DAGs with NO TEARS: Continuous Optimization for Structure LearningPreprint
Zheng, X., Aragam, B., Ravikumar, P., & Xing, E. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01422 · Cited by 488 · cited 1× · see citing works
“For example, comparing Zheng et al. [78] with the later Zheng et al. [79] using the latter of causation, implies that Zheng et al. [79] wrongly claimed an improvement on Zheng et al. [78] as they both transition from having no structural knowledge to plausible structural knowledge.”
Background
Nonparametric regression using deep neural networks with ReLU activation function
Schmidt-Hieber, J. (2020) · The Annals of Statistics · doi:10.1214/19-aos1875 · Cited by 469 · cited 1× · see citing works
“In fact, it has been shown that neural networks 5 have a connection to non-parametric regression, leading to high performance models [72].”
Background
Smoking and Mortality - Beyond Established Causes.
Carter, B., Abnet, C., Feskanich, D., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmx160037 · Cited by 424 · cited 1×
“2If cancer renders smoking and death independent, we imply that cancer is the only path from smoking to death, which is known to be false [59].”
Background
The Book of Why: The New Science of Cause and Effect†
Goldberg, L. R. (2019) · Quantitative finance (Print) · doi:10.1080/14697688.2019.1655928 · Cited by 354 · cited 5× · see citing works
“Originally introduced by Judea Pearl [1], the ladder is now considered central to the “Pearl causal hierarchy” (PCH) [10].”
BackgroundMethodInfluential
Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian ProcessesPreprint
Alaa, A. M., & van der Schaar, M. (2017) · Neural Information Processing Systems · doi:10.48550/arxiv.1704.02801 · Cited by 353 · cited 4× · see citing works
“Perhaps one of the most natural application domains for CDL is estimating causal treatment eﬀects [26–29].”
BackgroundMethodInfluentialSelf-citation
A Novel Bayes Model: Hidden Naive Bayes
Jiang, L.-X., Zhang, H., & Cai, Z.-H. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.234 · Cited by 346 · see citing works
Deep feature weighting for naive Bayes and its application to text classification
Jiang, L., Li, C., Wang, S., et al. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.02.002 · Cited by 327 · see citing works
Granger Causality and the Times Series Analysis of Political Relationships
Freeman, J. R. (1983) · American Journal of Political Science · doi:10.2307/2111021 · Cited by 324 · see citing works
Causal discovery with continuous additive noise models
Peters, J., Mooij, J. M., Janzing, D., & Schölkopf, B. (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2670315 · Cited by 318 · cited 4× · see citing works
“Making such a structural assumptions, before learning a graph using Peters et al. [73] would make our solution for the practitioner’s problem invalid once again.”
BackgroundMethodInfluential
Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node EmbeddingsPreprint
Chen, Y., Wu, L., & Zaki, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13009 · Cited by 281 · see citing works
Causal interpretability for machine learning-problems, methods and evaluation
Moraffah, R., Karami, M., Guo, R., Raglin, A., & Liu, H. (2020) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3400051.3400058 · Cited by 238 · see citing works
On the Identifiability of the Post-Nonlinear Causal ModelPreprint
Zhang, K., & Hyvärinen, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2599 · Cited by 229 · cited 1× · see citing works
“For a factor f i ( X ( i ) , U X ( i ) ) we make an assumption on how the noise variables U X ( i ) are incorporated in f i [68–70], for example, additive noise: In short, eq.”
Background
Causal Bandits: Learning Good Interventions via Causal Inference
Lattimore, F., Lattimore, T., & Reid, M. D. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1606.03203 · Cited by 205 · cited 7×
“Examples of this include bandit algorithms such as Lattimore et al. [74], which we discuss further using our map of CDL in section 4.”
BackgroundMethodInfluential
Randomization Analysis of Experimental Data: The Fisher Randomization Test
Basu*, D. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5825-9_28 · Cited by 197 · cited 1× · see citing works
“These assumptions vary from: knowing the ground-truth causal graph [2], or assuming all relevant variables are present in the data which cannot be guaranteed [3, 4].”
Background
Strong Completeness and Faithfulness in Bayesian Networks
Meek, C. (2013) · arXiv · doi:10.48550/arxiv.1302.4973 · Cited by 194 · see citing works
Causal Machine Learning: A Survey and Open Problems
Kaddour, J., Lynch, A., Liu, Q., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2206.15475 · Cited by 182 · cited 1×
“Review papers (such as [50, 51]) are very useful for the community as they collect and frame an enormous amount of relevant papers, but they do not help us to deﬁne a clear research agenda as they never (a) provide a distinction between causality, deep learning, and causal deep learning as the…”
Background
Causal Transformer for Estimating Counterfactual Outcomes
Melnychuk, V., Frauen, D., & Feuerriegel, S. (2022) · International Conference on Machine Learning · doi:10.48550/arxiv.2204.07258 · Cited by 182 · cited 1×
“However, there exist Gaussian processes [26] and transformer networks [57] alike, which have been trained explicitly to leverage causal knowledge.”
Background
Graphical Models for Processing Missing Data
Mohan, K., & Pearl, J. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1874961 · Cited by 178 · cited 1× · see citing works
“Furthermore, depending on which mechanism governs the missingness patterns, we may have to make additional structural assumptions before imputation can even begin [14, 16, 77].”
Background
On Pearl’s Hierarchy and the Foundations of Causal Inference
Bareinboim, E., Correa, J. D., Ibeling, D., & Icard, T. (2022) · Probabilistic and Causal Inference · doi:10.1145/3501714.3501743 · Cited by 174 · cited 5× · see citing works
“Originally introduced by Judea Pearl [1], the ladder is now considered central to the “Pearl causal hierarchy” (PCH) [10].”
BackgroundMethodInfluential
Graphical Modeling for Multivariate Hawkes Processes with Nonparametric Link Functions
Eichler, M., Dahlhaus, R., & Dueck, J. (2016) · doi:10.1111/jtsa.12213 · Cited by 174
Improving Tree augmented Naive Bayes for class probability estimation
Jiang, L., Cai, Z., Wang, D., & Zhang, H. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.08.010 · Cited by 144 · see citing works
Causal Inference for Recommender Systems
Wang, Z., Liang, D., Charlin, L., & Blei, D. M. (2020) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3383313.3412225 · Cited by 142 · cited 3× · see citing works
“…methods using a general multi-domain causal structure [23–25] Treatment eﬀects Learn models that respect identiﬁcation assumptions [26–39] Drug repurposing Relate multi-modal data using causal structure [40–44] Recommendation Infer causal eﬀect of recommendation [45–49] Table 1: Real-world impact.”
BackgroundMethod
Causality and forecasting in incomplete systems
Caporale, G., & Pittis, N. (1997) · Journal of Forecasting · doi:10.1002/(sici)1099-131x(199711)16:6 · Cited by 136 · see citing works
Causal Discovery with Reinforcement LearningPreprint
Zhu, S., Ng, I., & Chen, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04477 · Cited by 131 · see citing works
CausalGAN: Learning Causal Implicit Generative Models with Adversarial TrainingPreprint
Kocaoglu, M., Snyder, C., Dimakis, A. G., & Vishwanath, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02023 · Cited by 128 · see citing works
Invariance, Causality and Robustness
Bühlmann, P. (2020) · Statistical Science · doi:10.1214/19-sts721 · Cited by 127 · see citing works
TabPFN: A Transformer That Solves Small Tabular Classification Problems in a SecondPreprint
Hollmann, N., Müller, S., Eggensperger, K., & Hutter, F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.01848 · Cited by 126 · see citing works
Postdiagnosis Smoking Cessation and Reduced Risk for Lung Cancer Progression and Mortality
Sheikh, M., Феликсовна, М. А., Shangina, O., Brennan, P., & Zaridze, D. G. (2021) · Annals of Internal Medicine · doi:10.7326/m21-0252 · Cited by 126 · cited 1× · see citing works
“However, the reverse is true; when a cancer-patient stops smoking they have a higher chance of remission [63].”
Background
Weakly Supervised Disentangled Generative Causal Representation Learning
Shen, X., Liu, F.-R., Dong, H., et al. (2020) · Journal of machine learning research · doi:10.48550/arxiv.2010.02637 · Cited by 113
Causal Reasoning for Algorithmic FairnessPreprint
Loftus, J. R., Russell, C., Kusner, M. J., & Silva, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.05859 · Cited by 110 · see citing works
On the Logic of Causal Models
Geiger, D., & Pearl, J. (1990) · Machine intelligence and pattern recognition · doi:10.1016/b978-0-444-88650-7.50006-8 · Cited by 107 · see citing works
Representation Learning via Invariant Causal MechanismsPreprint
Mitrovic, J., McWilliams, B., Walker, J., Buesing, L., & Blundell, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07922 · Cited by 106 · see citing works
Learning sparse nonparametric DAGs.
Zheng, X., Dan, C., Aragam, B., Ravikumar, P., & Xing, E. P. (2019) · arXiv · doi:10.48550/arxiv.1909.13189 · Cited by 103 · cited 1× · see citing works
“For example, comparing Zheng et al. [78] with the later Zheng et al. [79] using the latter of causation, implies that Zheng et al. [79] wrongly claimed an improvement on Zheng et al. [78] as they both transition from having no structural knowledge to plausible structural knowledge.”
Background
Machine Learning Applications in Drug Repurposing
Yang, F., Zhang, Q., Ji, X., Zhang, Y., Li, W., Peng, S., & Xue, F. (2022) · Interdisciplinary Sciences Computational Life Sciences · doi:10.1007/s12539-021-00487-8 · Cited by 100 · cited 1× · see citing works
“At the intersection of generalisation and treatment eﬀects is drug repurposing, an incredibly exciting area for CDL to have impact [43, 44].”
Background
Estimating the Causal Impact of Recommendation Systems from Observational Data
Sharma, A. K., Hofman, J. M., & Watts, D. J. (2015) · ACM Conference on Economics and Computation (EC) · doi:10.1145/2764468.2764488 · Cited by 97 · cited 1× · see citing works
“CDL can also be used to infer the causal eﬀect of online store recommendations [45, 47, 48], which is essential for accurate evaluation of recommendation algorithms.”
Background
Deep Structural Causal Models for Tractable Counterfactual InferencePreprint
Pawlowski, N., Castro, D. C., & Glocker, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06485 · Cited by 96 · cited 1× · see citing works
“With much less strict assumptions and based on the enormous ﬂexibility of deep learning models [6–8], CDL is uniquely positioned to provide solutions to these challenging settings [9].”
Background
Ordering-Based Causal Discovery with Reinforcement Learning
Wang, X., Du, Y.-L., Zhu, S.-Y., et al. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/491 · Cited by 96
Invariant Causal Prediction for Sequential Data
Pfister, N., Bühlmann, P., & Peters, J. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1491403 · Cited by 93 · see citing works
Introduction to the foundations of causal discovery
Eberhardt, F. (2016) · International Journal of Data Science and Analytics · doi:10.1007/s41060-016-0038-6 · Cited by 91 · cited 1× · see citing works
“It is also long thought to be impossible [81–84].”
Background
SLAPS: Self-Supervision Improves Structure Learning for Graph Neural NetworksPreprint
Fatemi, B., Asri, L. E., & Kazemi, S. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05034 · Cited by 90 · see citing works
Strong Universal Consistency of Neural Network Classifiers
Faragó, A., & Lugosi, G. (1993) · Proceedings. IEEE International Symposium on Information Theory · doi:10.1109/isit.1993.748747 · Cited by 89
PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems
Ghazimatin, A., Balalau, O., Saha Roy, R., & Weikum, G. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371824 · Cited by 88 · cited 3× · see citing works
“…methods using a general multi-domain causal structure [23–25] Treatment eﬀects Learn models that respect identiﬁcation assumptions [26–39] Drug repurposing Relate multi-modal data using causal structure [40–44] Recommendation Infer causal eﬀect of recommendation [45–49] Table 1: Real-world impact.”
BackgroundMethod
CASTLE: Regularization via Auxiliary Causal Graph DiscoveryPreprint
Kyono, T., Zhang, Y., & van der Schaar, M. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2009.13180 · Cited by 82 · see citing works
Self-citation
Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced RepresentationsPreprint
Bica, I., Alaa, A. M., Jordon, J., & van der Schaar, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04083 · Cited by 80 · see citing works
Self-citation
Causal Bayesian Optimization
Aglietti, V., Lu, X., Paleyes, A., et al. (2020) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2005.11741 · Cited by 80
Intervention and Causality: Forecasting Traffic Flows Using a Dynamic Bayesian Network
Queen, C. M., & Albers, C. J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0042 · Cited by 78 · see citing works
Achieving Causal Fairness through Generative Adversarial Networks
Xu, D., Wu, Y., Yuan, S., Zhang, L., & Wu, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/201 · Cited by 76 · see citing works
CounterFactual Regression with Importance Sampling Weights
Hassanpour, N., & Greiner, R. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/815 · Cited by 75 · cited 1× · see citing works
“Perhaps one of the most natural application domains for CDL is estimating causal treatment eﬀects [26–29].”
Background
Causal Reasoning from Meta-reinforcement Learning
Dasgupta, I., Wang, J., Chiappa, S., Mitrovic, J., Ortega, P., Raposo, D., Hughes, E., Battaglia, P., Botvinick, M., & Kurth-Nelson, Z. (2019) · arXiv · doi:10.48550/arxiv.1901.08162 · Cited by 71 · cited 1× · see citing works
“In fact, some results seem to indicate that some models may even exhibit causal knowledge without being trained for it explicitly [152].”
Background
Machine learning for clinical trials in the era of COVID-19
Zame, W. R., Bica, I., Shen, C., Curth, A., Lee, H.-S., Bailey, S., Weatherall, J. H., Wright, D. N. M., Bretz, F., & van der Schaar, M. (2020) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1797867 · Cited by 70 · cited 1× · see citing works
“With applications in donor-organ transplantation [31, 32], cancer [33–35], and COVID-19 [36] and its impact [37].”
BackgroundSelf-citation
Imputation approaches for potential outcomes in causal inference
Westreich, D., Edwards, J. K., Cole, S. R., Platt, R. W., Mumford, S. L., & Schisterman, E. F. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv135 · Cited by 64 · see citing works
An Intermediate Representation for Optimizing Machine Learning Pipelines
Kunft, A., Katsifodimos, A., Schelter, S., et al. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3342263.3342633 · Cited by 62 · cited 1×
“However, often real-world scenarios can be much more complicated and require more than two cascading models to solve a particular problem [75, 76].”
Background
Provably Efficient Causal Reinforcement Learning with Confounded Observational Data
Wang, L.-X., Yang, Z., & Wang, Z. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2006.12311 · Cited by 61
Optimal rate of direct estimators in systems of ordinary differential equations linear in functions of the parameters
Dattner, I., & Klaassen, C. (2013) · doi:10.1214/15-ejs1053 · Cited by 60
Causal network models of SARS-CoV-2 expression and aging to identify candidates for drug repurposing
Belyaeva, A., Cammarata, L. V., Radhakrishnan, A., Squires, C., Yang, K., Shivashankar, G. V., & Uhler, C. (2021) · Nature Communications · doi:10.1038/s41467-021-21056-z · Cited by 60 · cited 2× · see citing works
“…methods using a general multi-domain causal structure [23–25] Treatment eﬀects Learn models that respect identiﬁcation assumptions [26–39] Drug repurposing Relate multi-modal data using causal structure [40–44] Recommendation Infer causal eﬀect of recommendation [45–49] Table 1: Real-world impact.”
Method
Causal network inference using biochemical kinetics
Oates, C. J., Dondelinger, F., Bayani, N., Korkola, J. E., Gray, J. W., & Mukherjee, S. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu452 · Cited by 58 · see citing works
ESTIMATING PERSON‐CENTERED TREATMENT (PeT) EFFECTS USING INSTRUMENTAL VARIABLES: AN APPLICATION TO EVALUATING PROSTATE CANCER TREATMENTS
Basu, A. (2013) · Journal of Applied Econometrics · doi:10.1002/jae.2343 · Cited by 55 · see citing works
Fast Gaussian Process Based Gradient Matching for Parameter Identification in Systems of Nonlinear ODEs
Wenk, P., Gotovos, A., Bauer, S., et al. (2018) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.1804.04378 · Cited by 54
Causal Bandits with Unknown Graph Structure
Lu, Y.-Y., Meisami, A., & Tewari, A. (2021) · Neural Information Processing Systems · doi:10.48550/arxiv.2106.02988 · Cited by 53
Generative Interventions for Causal Learning
Mao, C., Cha, A., Gupta, A., Wang, H., Yang, J., & Vondrick, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00394 · Cited by 52 · see citing works
PC-Fairness: A Unified Framework for Measuring Causality-based FairnessPreprint
Wu, Y., Zhang, L., Wu, X., & Tong, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12586 · Cited by 51 · cited 1× · see citing works
“…unfairness in machine learning models by learning a representation of the data that is fair with respect to a given set of protected attributes and their causal neighbors [18–20 The authors showed that their method outperforms existing fairness methods in terms of both fairness and accuracy.”
Method
Contextual Bandits with Latent Confounders: An NMF Approach
Sen, R., Shanmugam, K., Kocaoglu, M., et al. (2016) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.1606.00119 · Cited by 50
Counterfactual Generative NetworksPreprint
Sauer, A., & Geiger, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06046 · Cited by 49 · see citing works
Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective
Liu, Y., Cadei, R., Schweizer, J., Bahmani, S., & Alahi, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01657 · Cited by 49 · see citing works
Causal inference in medical records and complementary systems pharmacology for metformin drug repurposing towards dementia
Charpignon, M., Vakulenko‐Lagun, B., Zheng, B., Magdamo, C., Su, B., Evans, K. E., Rodriguez, S., Sokolov, A., Boswell, S. A., Sheu, Y.-H., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-35157-w · Cited by 47 · cited 1× · see citing works
“With applications in COVID-19 [40] and dementia [41, 42], CDL is already proving to be a useful framework.”
Method
Budgeted and Non-budgeted Causal Bandits
Nair, V., Patil, V., & Sinha, G. (2020) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2012.07058 · Cited by 46
On the Opportunity of Causal Learning in Recommendation Systems: Foundation, Estimation, Prediction and Challenges
Wu, P., Li, H., Deng, Y., Hu, W., Dai, Q., Dong, Z., Sun, J., Zhang, R., & Zhou, X. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/787 · Cited by 44 · cited 1× · see citing works
“CDL can also be used to infer the causal eﬀect of online store recommendations [45, 47, 48], which is essential for accurate evaluation of recommendation algorithms.”
Background
Dynamic Causal Bayesian Optimization
Aglietti, V., Dhir, N., González, J., et al. (2021) · Neural Information Processing Systems · doi:10.48550/arxiv.2110.13891 · Cited by 40
Invariant Representation Learning for Treatment Effect EstimationPreprint
Shi, C., Veitch, V., & Blei, D. (2020) · Conference on Uncertainty in Artificial Intelligence · doi:10.48550/arxiv.2011.12379 · Cited by 38 · cited 2× · see citing works
“Speciﬁcally, causal structures can be used to select models in a new domain as (partial) causal knowledge is assumed invariant [23–25], yielding more robust model selections with increased performance as a result.”
BackgroundMethod
Causality Learning: A New Perspective for Interpretable Machine LearningPreprint
Xu, G., Duong, T. D., Li, Q., Liu, S., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16789 · Cited by 37 · cited 1× · see citing works
“Examples such as these include: domain adaptation [24, 85], transfer learning [86, 87], interpretability [88–91], or general robustness [92–95].”
Background
Doubly robust treatment effect estimation with missing attributes
Mayer, I., Sverdrup, E., Gauss, T., Moyer, J.-D., Wager, S., & Josse, J. (2020) · The Annals of Applied Statistics · doi:10.1214/20-aoas1356 · Cited by 33 · cited 2× · see citing works
“For example, CDL-based approaches allow deep learning to accurately impute missing values, respecting the causal interaction between missingness indicators and treatment selection [14–16].”
Background
Non-parametric individual treatment effect estimation for survival data with random forests
Tabib, S., & Larocque, D. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz602 · Cited by 32 · cited 1× · see citing works
“With applications in donor-organ transplantation [31, 32], cancer [33–35], and COVID-19 [36] and its impact [37].”
Background
Incorporating causality in energy consumption forecasting using deep neural networks
Sharma, K., Dwivedi, Y. K., & Metri, B. A. (2022) · Annals of Operations Research · doi:10.1007/s10479-022-04857-3 · Cited by 32 · see citing works
Gradient Matching Methods for Computational Inference in Mechanistic Models for Systems Biology: A Review and Comparative Analysis
Macdonald, B., & Husmeier, D. (2015) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2015.00180 · Cited by 31
DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative NetworksPreprint
van Breugel, B., Kyono, T., Berrevoets, J., & van der Schaar, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12884 · Cited by 30 · cited 2× · see citing works
“Identify of sources of unfairness [18–22]”
MethodSelf-citation
Learning Causal Representation for Training Cross-Domain Pose Estimator via Generative Interventions
Zhang, X., Wong, Y., Wu, X., Lu, J., Kankanhalli, M., Li, X., & Geng, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01108 · Cited by 30 · cited 1× · see citing works
“Examples such as these include: domain adaptation [24, 85], transfer learning [86, 87], interpretability [88–91], or general robustness [92–95].”
Background
Bandits with partially observable confounded data
Tennenholtz, G., Shalit, U., Mannor, S., et al. (2020) · Conference on Uncertainty in Artificial Intelligence · doi:10.48550/arxiv.2006.06731 · Cited by 30
Causal Influence Detection for Improving Efficiency in Reinforcement LearningPreprint
Seitzer, M., Schölkopf, B., & Martius, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03443 · Cited by 29 · see citing works
Causal Generative Neural NetworksPreprint
Goudet, O., Kalainathan, D., Caillou, P., Guyon, I., López-Paz, D., & Sébag, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08936 · Cited by 29 · see citing works
Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework
Shi, C., Wang, X., Luo, S., Hongtu Zhu, B., Ye, J., & Song, R. (2022) · Journal of the American Statistical Association · doi:10.1080/01621459.2022.2027776 · Cited by 29 · see citing works
Visual Commonsense Representation Learning via Causal Inference
Wang, T., Huang, J., Zhang, H., & Sun, Q. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00197 · Cited by 28 · cited 1× · see citing works
“Examples such as these include: domain adaptation [24, 85], transfer learning [86, 87], interpretability [88–91], or general robustness [92–95].”
Background
MIRACLE: Causally-Aware Imputation via Learning Missing Data MechanismsPreprint
Kyono, T., Zhang, Y., Bellot, A., & van der Schaar, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03187 · Cited by 27 · cited 1× · see citing works
“Deﬁne interaction eﬀects of missingness and covariates [12–17]”
Self-citation
Learning Robust Models Using The Principle of Independent Causal Mechanisms
Müller, J., Schmier, R., Ardizzone, L., et al. (2020) · German Conference on Pattern Recognition · doi:10.1007/978-3-030-92659-5_6 · Cited by 27
An Enhanced Naive Bayes Model for Dissolved Oxygen Forecasting in Shellfish Aquaculture
Li, D., Sun, J., Yang, H., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3042180 · Cited by 27 · see citing works
On Inductive Biases for Heterogeneous Treatment Effect EstimationPreprint
Curth, A., & van der Schaar, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03765 · Cited by 25 · see citing works
Self-citation
Adaptively Exploiting d-Separators with Causal Bandits
Bilodeau, B., Wang, L., & Roy, D. M. (2022) · Neural Information Processing Systems · doi:10.52202/068431-1482 · Cited by 25
Causal-TGAN: Generating Tabular Data Using Causal Generative Adversarial Networks
Wen, B., Colón, L. O., Subbalakshmi, K. P., et al. (2021) · arXiv.org · doi:10.48550/arxiv.2104.10680 · Cited by 25
Causal Bandits without prior knowledge using separating sets
de Kroon, A. D., Mooij, J., & Belgrave, D. (2020) · CLEaR · doi:10.48550/arxiv.2009.07916 · Cited by 25
Simultaneous Missing Value Imputation and Structure Learning with Groups
Morales-Álvarez, P., Gong, W., Lamb, A., et al. (2021) · Neural Information Processing Systems · doi:10.52202/068431-1455 · Cited by 24 · cited 1×
“Deﬁne interaction eﬀects of missingness and covariates [12–17]”
Causal Models for Dynamical Systems
Peters, J., Bauer, S., & Pfister, N. (2022) · ACM eBooks · doi:10.1145/3501714.3501752 · Cited by 23 · cited 1× · see citing works
“Furthermore, inferring causality over time requires very diﬀerent assumptions and models and should not be compared directly with models that operate in a static setting [11, 58].”
Method
To Impute or not to Impute? - Missing Data in Treatment Effect Estimation
Berrevoets, J., Imrie, F., Kyono, T., et al. (2022) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2202.02096 · Cited by 23 · cited 2×
“For example, CDL-based approaches allow deep learning to accurately impute missing values, respecting the causal interaction between missingness indicators and treatment selection [14–16].”
BackgroundSelf-citation
Structural Causal Bandits with Non-Manipulable Variables
Lee, S., & Bareinboim, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014164 · Cited by 22 · see citing works
Causal Reinforcement Learning using Observational and Interventional DataPreprint
Gasse, M., Grasset, D., Gaudron, G., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14421 · Cited by 22 · see citing works
A Meta-Reinforcement Learning Algorithm for Causal Discovery
Sauter, A., Acar, E., & François-Lavet, V. (2022) · CLEaR · doi:10.48550/arxiv.2207.08457 · Cited by 22
Matching Learned Causal Effects of Neural Networks with Domain Priors
Kancheti, S. S., Reddy, A. G., Balasubramanian, V. N., et al. (2021) · International Conference on Machine Learning · doi:10.48550/arxiv.2111.12490 · Cited by 19
A causal bandit approach to learning good atomic interventions in presence of unobserved confounders
Maiti, A., Nair, V., & Sinha, G. (2021) · Conference on Uncertainty in Artificial Intelligence · doi:10.48550/arxiv.2107.02772 · Cited by 19
Incorporating Causal Graphical Prior Knowledge into Predictive Modeling via Simple Data Augmentation
Teshima, T., & Sugiyama, M. (2021) · Conference on Uncertainty in Artificial Intelligence · doi:10.48550/arxiv.2103.00136 · Cited by 18 · cited 1×
“l [96, 97] l [17, 66, 98–101] l [102, 103] l [104]”
Boosting Synthetic Data Generation with Effective Nonlinear Causal Discovery
Cinquini, M., Giannotti, F., & Guidotti, R. (2021) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi52975.2021.00016 · Cited by 16 · see citing works
GFlowCausal: Generative Flow Networks for Causal Discovery
Li, W., Li, Y.-C., Zhu, S.-Y., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2210.08185 · Cited by 15
Exploiting Causal Structure for Robust Model Selection in Unsupervised Domain Adaptation
Kyono, T., & van der Schaar, M. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3101185 · Cited by 14 · cited 1× · see citing works
“Examples such as these include: domain adaptation [24, 85], transfer learning [86, 87], interpretability [88–91], or general robustness [92–95].”
BackgroundSelf-citation
Improving Model Robustness Using Causal Knowledge
Kyono, T., & van der Schaar, M. (2019) · arXiv.org · doi:10.48550/arxiv.1911.12441 · Cited by 14 · cited 1×
“Another approach is to leverage causal knowledge to perform the imputation task directly [13, 93].”
BackgroundSelf-citation
Déjà Vu: The Importance of Time and Causality in Recommender Systems
Basilico, J., & Raimond, Y. (2017) · ACM Conference on Recommender Systems · doi:10.1145/3109859.3109922 · Cited by 14 · cited 1×
“Furthermore, Basilico and Raimond [46] illustrate the importance of causality and time to provide meaningful recommendations, again highlighting the importance of our temporal dimension!”
Background
Causality and Batch Reinforcement Learning: Complementary Approaches To Planning In Unknown DomainsPreprint
Bannon, J., Windsor, B., Song, W., & Li, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02579 · Cited by 12 · cited 1× · see citing works
“However, recent work has shown that there may be an even deeper connection between causality and bandits and RL [174].”
Background
Learning Interpretable Models with Causal GuaranteesPreprint
Kim, C., & Bastani, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08576 · Cited by 12 · see citing works
Learning Large Scale Ordinary Differential Equation Systems
Mikkelsen, F. V., & Hansen, N. R. (2017) · doi:10.48550/arxiv.1710.09308 · Cited by 12
Causal Deep Reinforcement Learning using Observational Data
Zhu, W., Yu, C., & Zhang, Q. (2022) · International Joint Conference on Artificial Intelligence · doi:10.48550/arxiv.2211.15355 · Cited by 10
Proactive Pseudo-Intervention: Causally Informed Contrastive Learning For Interpretable Vision ModelsPreprint
Wang, D., Yang, Y., Tao, C., Gan, Z., Chen, L., Kong, F., Henao, R., & Carin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03369 · Cited by 10 · see citing works
A large-scale observational study of the causal effects of a behavioral health nudge
Nazaret, A., & Sapiro, G. (2023) · Science Advances · doi:10.1126/sciadv.adi1752 · Cited by 9 · cited 1× · see citing works
“Constrain methods using a general multi-domain causal structure [23–25] Treatment eﬀects Learn models that respect identiﬁcation assumptions [26–39] Drug repurposing Relate multi-modal data using causal structure [40–44] Recommendation Infer causal eﬀect of recommendation [45–49] Table 1:…”
Method
CMGAN: A generative adversarial network embedded with causal matrix
Zhang, W., Liao, J., Zhang, Y., & Liu, L. (2022) · Applied Intelligence · doi:10.1007/s10489-021-03094-8 · Cited by 9 · see citing works
Causal Bandits: Online Decision-Making in Endogenous Settings
Zhang, J.-W., Chen, Y., & Singh, A. (2022) · Social Science Research Network · doi:10.2139/ssrn.4278162 · Cited by 9
Causal Imputation via Synthetic InterventionsPreprint
Squires, C., Shen, D., Agarwal, A., Devavrat Shah, B., & Uhler, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03127 · Cited by 8 · cited 1× · see citing works
“Another approach is to leverage causal knowledge to perform the imputation task directly [13, 93].”
Background
Selecting Treatment Effects Models for Domain Adaptation Using Causal Knowledge
Kyono, T., Bica, I., Qian, Z., et al. (2021) · ACM Trans. Comput. Heal. · doi:10.1145/3587695 · Cited by 8 · cited 2×
“Speciﬁcally, causal structures can be used to select models in a new domain as (partial) causal knowledge is assumed invariant [23–25], yielding more robust model selections with increased performance as a result.”
BackgroundMethodSelf-citation
On the Opportunity of Causal Deep Generative Models: A Survey and Future Directions
Zhou, G.-L., Yao, L., Xu, X.-W., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2301.12351 · Cited by 8 · cited 1×
“9 we only consider research that explicitly discusses causality [175].”
Background
Causal Discovery and Injection for Feed-Forward Neural Networks
Russo, F., & Toni, F. (2022) · arXiv.org · doi:10.48550/arxiv.2205.09787 · Cited by 8 · cited 1×
“l [96, 97] l [17, 66, 98–101] l [102, 103] l [104]”
Drug repurposing of metformin for Alzheimer’s disease: Combining causal inference in medical records data and systems pharmacology for biomarker identificationPreprint
Charpignon, M., Vakulenko‐Lagun, B., Zheng, B., Magdamo, C., Su, B., Evans, K. E., Rodriguez, S., Sokolov, A., Boswell, S. A., Sheu, Y.-H., et al. (2021) · medRxiv · doi:10.1101/2021.08.10.21261747 · Cited by 7 · cited 1× · see citing works
“With applications in COVID-19 [40] and dementia [41, 42], CDL is already proving to be a useful framework.”
Method
Reinforcement Learning of Causal Variables Using Mediation Analysis
Herlau, T., & Larsen, R. F. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20648 · Cited by 7 · see citing works
Individual treatment effect estimation in the presence of unobserved confounding using proxies: a cohort study in stage III non-small cell lung cancer
van Amsterdam, W. A. C., Verhoeff, J. J. C., Harlianto, N. I., Bartholomeus, G. A., Puli, A. M., de Jong, P. A., Leiner, T., van Lindert, A. S. R., Eijkemans, M. J. C., & Ranganath, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-09775-9 · Cited by 6 · see citing works
Causal Counterfactuals for Improving the Robustness of Reinforcement Learning
He, T., Gajcin, J., & Dusparic, I. (2022) · arXiv.org · doi:10.48550/arxiv.2211.05551 · Cited by 6
Treatment effect optimisation in dynamic environments
Berrevoets, J., Verboven, S., & Verbeke, W. (2022) · Journal of Causal Inference · doi:10.1515/jci-2020-0009 · Cited by 5 · see citing works
Self-citation
Improving Fair Predictions Using Variational Inference In Causal ModelsPreprint
Helwegen, R., Louizos, C., & Forré, P. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10880 · Cited by 3 · cited 1× · see citing works
“Identify of sources of unfairness [18–22]”
The Impact of COVID-19 on Airfares—A Machine Learning Counterfactual Analysis
Wozny, F. (2022) · Econometrics · doi:10.3390/econometrics10010008 · Cited by 3 · cited 1×
“With applications in donor-organ transplantation [31, 32], cancer [33–35], and COVID-19 [36] and its impact [37].”
Background
Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential EquationsPreprint
Seedat, N., Imrie, F., Bellot, A., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.08311 · Cited by 3 · see citing works
Evaluating the heterogeneous effect of extended incubation to blastocyst transfer on the implantation outcome via causal inferencePreprint
Kan‐Tor, Y., Srebnik, N., Gavish, M., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.02.466894 · Cited by 2 · see citing works
When deep learning meets causal inference: a computational framework for drug repurposing from real-world dataPreprint
Liu, R., Wei, L., & Zhang, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.10152 · Cited by 2 · cited 2× · see citing works
“…methods using a general multi-domain causal structure [23–25] Treatment eﬀects Learn models that respect identiﬁcation assumptions [26–39] Drug repurposing Relate multi-modal data using causal structure [40–44] Recommendation Infer causal eﬀect of recommendation [45–49] Table 1: Real-world impact.”
BackgroundMethod
Adaptively Exploiting d-Separators with Causal BanditsPreprint
Bilodeau, B., Wang, L., & Roy, D. M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.05100 · Cited by 2 · see citing works
Path-specific Causal Fair Prediction via Auxiliary Graph Structure Learning
Yao, L., Li, Y., Ding, B., Zhou, J., Liu, J., Huai, M., & Gao, J. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583280 · Cited by 1 · see citing works
Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over TimePreprint
Berrevoets, J., Curth, A., Bica, I., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.03811 · Cited by 1 · see citing works
Self-citation
Causal Bandits: Online Decision-Making in Endogenous SettingsPreprint
Zhang, J., Chen, Y., & Singh, A. (2022) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2211.08649
Selecting Treatment Effects Models for Domain Adaptation Using Causal KnowledgePreprint
Kyono, T., Bica, I., Qian, Z., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06271
Self-citation

Flagged first, then by citations

Research works printed but not linked: 73

Nick Pawlowski, Jeroen Berrevoets, Caroline Uhler, Kun Zhang, Mihaela van der Schaar, and Cheng Zhang. NeurIPS workshop on causal machine learning for real-world impact (CML4Impact), 2022. URL https://www.cml-4-impact.vanderschaar-lab.com/.
Guido W Imbens. Potential outcome and directed acyclic graph approaches to causality: Relevance for empirical practice in economics. Journal of Economic Literature, 58(4):1129-79, 2020.
Judea Pearl. Bayesianism and causality, or, why i am only a half-bayesian. In Foundations of bayesian- ism, pages 19-36. Springer, 2001.
Daphne Koller and Nir Friedman. Probabilistic graphical models: principles and techniques. MIT press, 2009.
Xiaohai Sun, Dominik Janzing, and Bernhard Schölkopf. Causal inference by choosing graphs with most plausible markov kernels. In Ninth International Symposium on Artificial Intelligence and Mathematics (AIMath 2006), pages 1-11, 2006.
Judea Pearl. Causality. Cambridge university press, 2009.
Vladimir N Vapnik and A Ya Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. In Measures of complexity: festschrift for alexey chervonenkis, pages 11-30. Springer, 2015.
Patrik Hoyer, Dominik Janzing, Joris M Mooij, Jonas Peters, and Bernhard Schölkopf. Nonlinear causal discovery with additive noise models. Advances in neural information processing systems, 21, 2008.
Jonas Peters, Dominik Janzing, and Bernhard Schölkopf. Elements of causal inference: foundations and learning algorithms. The MIT Press, 2017.
Michael Naaman. On the tight constant in the multivariate dvoretzky-kiefer-wolfowitz inequality. Statistics & Probability Letters, 173:109088, 2021.
Carlos M Jarque and Anil K Bera. Efficient tests for normality, homoscedasticity and serial indepen- dence of regression residuals. Economics letters, 6(3):255-259, 1980.
Abraham Savitzky and Marcel JE Golay. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry, 36(8):1627-1639, 1964.
Xun Zheng, Chen Dan, Bryon Aragam, Pradeep Ravikumar, and Eric Xing. Learning sparse nonpara- metric dags. In International Conference on Artificial Intelligence and Statistics, pages 3414-3425. PMLR, 2020.
James M Robins, Miguel Angel Hernan, and Babette Brumback. Marginal structural models and causal inference in epidemiology. Epidemiology, pages 550-560, 2000.
Samuel Holt, Jeroen Berrevoets, Krzysztof Kacprzyk, Zhaozhi Qian, and Mihaela van der Schaar. ODE discovery for longitudinal heterogeneous treatment effects inference. In The Twelfth International Con- ference on Learning Representations, 2024. URL https://openreview.net/forum?id=pxI5IPeWgW.
Jeroen Berrevoets, Ahmed Alaa, Zhaozhi Qian, James Jordon, Alexander E. S. Gimson, and Mihaela van der Schaar. Learning queueing policies for organ transplantation allocation us- ing interpretable counterfactual survival analysis. In Marina Meila and Tong Zhang, edi- tors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 792-802. PMLR, 18-24 Jul 2021. URL https://proceedings.mlr.press/v139/berrevoets21a.html.
Finnian Lattimore, Tor Lattimore, and Mark D Reid. Causal bandits: Learning good interventions via causal inference. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 29.
Curran Associates, Inc., 2016. URL https://proceedings.neurips.cc/paper/2016/file/b4288d9c0ec0a1841b3b3728321e7088-Paper.pdf.
Jennifer L Hill. Bayesian nonparametric modeling for causal inference. Journal of Computational and Graphical Statistics, 20(1):217-240, 2011.
Alicia Curth, David Svensson, Jim Weatherall, and Mihaela van der Schaar. Really doing great at estimating cate? a critical look at ml benchmarking practices in treatment effect estimation. In Thirty-fifth conference on neural information processing systems datasets and benchmarks track (round 2), 2021.
Alicia Curth and Mihaela van der Schaar. Nonparametric estimation of heterogeneous treatment effects: From theory to learning algorithms. In International Conference on Artificial Intelligence and Statistics, pages 1810-1818. PMLR, 2021.
Sören R Künzel, Jasjeet S Sekhon, Peter J Bickel, and Bin Yu. Metalearners for estimating heteroge- neous treatment effects using machine learning. Proceedings of the national academy of sciences, 116 (10):4156-4165, 2019.
Paul W Holland. Statistics and causal inference. Journal of the American statistical Association, 81 (396):945-960, 1986.
Uri Shalit, Fredrik D Johansson, and David Sontag. Estimating individual treatment effect: general- ization bounds and algorithms. In International Conference on Machine Learning, pages 3076-3085. PMLR, 2017.
Thomas S Richardson and James M Robins. Single world intervention graphs (swigs): A unification of the counterfactual and graphical approaches to causality. Center for the Statistics and the Social Sciences, University of Washington Series. Working Paper, 128(30):2013, 2013.
Donald B Rubin. Comment: Neyman (1923) and causal inference in experiments and observational studies. Statistical Science, 5(4):472-480, 1990.
Guido W Imbens and Donald B Rubin. Causal inference in statistics, social, and biomedical sciences. Cambridge University Press, 2015.
Bryan Lim. Forecasting treatment responses over time using recurrent marginal structural networks. Advances in neural information processing systems, 31, 2018.
Toon Vanderschueren, Alicia Curth, Wouter Verbeke, and Mihaela Van Der Schaar. Accounting for informative sampling when learning to forecast treatment outcomes over time. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scar- lett, editors, Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 34855-34874. PMLR, 23-29 Jul 2023. URL https://proceedings.mlr.press/v202/vanderschueren23a.html.
Jeroen Berrevoets, James Jordon, Ioana Bica, Mihaela van der Schaar, et al. Organite: Optimal transplant donor organ offering using an individual treatment effect. Advances in neural information processing systems, 33:20037-20050, 2020.
Jinsung Yoon, James Jordon, and Mihaela Van Der Schaar. Ganite: Estimation of individualized treat- ment effects using generative adversarial nets. In International conference on learning representations, 2018.
Toon Vanderschueren, Jeroen Berrevoets, and Wouter Verbeke. NOFLITE: Learning to predict individ- ual treatment effect distributions. Transactions on Machine Learning Research, 2023. ISSN 2835-8856. URL https://openreview.net/forum?id=EjqopDxLbG.
Ioana Bica, James Jordon, and Mihaela van der Schaar. Estimating the effects of continuous- valued interventions using generative adversarial networks. In H. Larochelle, M. Ran- zato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Pro- cessing Systems, volume 33, pages 16434-16445.
Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper_files/paper/2020/file/bea5955b308361a1b07bc55042e25e54-Paper.p
Jeroen Berrevoets, Ahmed Alaa, Zhaozhi Qian, James Jordon, Alexander ES Gimson, and Mihaela Van Der Schaar. Learning queueing policies for organ transplantation allocation using interpretable counterfactual survival analysis. In International Conference on Machine Learning, pages 792-802. PMLR, 2021.
Johann Brehmer, Pim De Haan, Phillip Lippe, and Taco S Cohen. Weakly supervised causal repre- sentation learning. Advances in Neural Information Processing Systems, 35:38319-38331, 2022.
Pim De Haan, Dinesh Jayaraman, and Sergey Levine. Causal confusion in imitation learning. Advances in Neural Information Processing Systems, 32, 2019.
Phillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M Asano, Taco Cohen, and Efstratios Gavves. Causal representation learning for instantaneous and temporal effects in interactive systems. In The Eleventh International Conference on Learning Representations, 2022.
Chaochao Lu, José Miguel Hernández-Lobato, and Bernhard Schölkopf. Invariant causal representation learning for generalization in imitation and reinforcement learning. In ICLR2022 Workshop on the Elements of Reasoning: Objects, Structure and Causality, 2022.
Kartik Ahuja, Divyat Mahajan, Yixin Wang, and Yoshua Bengio. Interventional causal representation learning. In International conference on machine learning, pages 372-407. PMLR, 2023.
Aapo Hyvärinen. Independent component analysis: recent advances. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 371(1984):20110534, 2013.
Aapo Hyvärinen and Erkki Oja. Independent component analysis: algorithms and applications. Neural networks, 13(4-5):411-430, 2000.
Yao Zhang, Jeroen Berrevoets, and Mihaela Van Der Schaar. Identifiable energy-based representations: An application to estimating heterogeneous causal effects. In International Conference on Artificial Intelligence and Statistics, pages 4158-4177. PMLR, 2022.
Aapo Hyvärinen and Petteri Pajunen. Nonlinear independent component analysis: Existence and uniqueness results. Neural networks, 12(3):429-439, 1999.
Janine Witte, Leonard Henckel, Marloes H Maathuis, and Vanessa Didelez. On efficient adjustment in causal graphs. The Journal of Machine Learning Research, 21(1):9956-10000, 2020.
Kevin P Murphy. Machine learning: a probabilistic perspective. MIT press, 2012.
Mateo Rojas-Carulla, Bernhard Schölkopf, Richard Turner, and Jonas Peters. Invariant models for causal transfer learning. The Journal of Machine Learning Research, 19(1):1309-1342, 2018.
Sara Magliacane, Thijs van Ommen, Tom Claassen, Stephan Bongers, Philip Versteeg, and Joris M Mooij. Causal transfer learning. arXiv preprint arXiv:1707.06422, 2017. · arXiv
Pablo Morales-Alvarez, Angus Lamb, Simon Woodhead, Simon Peyton Jones, Miltiadis Allamanis, and Cheng Zhang. Vicause: Simultaneous missing value imputation and causal discovery with groups. arXiv preprint arXiv:2110.08223, 2021. · arXiv
Ron Kohavi et al. Scaling up the accuracy of naive-bayes classifiers: A decision-tree hybrid. In Kdd, volume 96, pages 202-207, 1996.
Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/file/e05c7ba4e087beea9410929698dc41a6-Paper.pdf.
Pat Langley, Wayne Iba, Kevin Thompson, et al. An analysis of bayesian classifiers. In Aaai, volume 90, pages 223-228, 1992.
Ben Calderhead, Mark Girolami, and Neil Lawrence. Accelerating bayesian inference over nonlinear differential equations with gaussian processes. Advances in neural information processing systems, 21, 2008.
Niklas Pfister, Stefan Bauer, and Jonas Peters. Identifying causal structure in large-scale kinetic systems. arXiv, pages 1810-11776, 2018.
Sanghack Lee and Elias Bareinboim. Structural causal bandits: Where to intervene? In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 31.
Curran Associates, Inc., 2018. URL https://proceedings.neurips.cc/paper/2018/file/c0a271bc0ecb776a094786474322cb82-Paper.pdf.
Sanghack Lee and Elias Bareinboim. Characterizing optimal mixed policies: Where to intervene and what to observe. In H. Larochelle, M. Ranzato, R. Had- sell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Process- ing Systems, volume 33, pages 8565-8576.
Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/file/61a10e6abb1149ad9d08f303267f9bc4-Paper.pdf.
Chandrasekar Subramanian and Balaraman Ravindran. Causal contextual bandits with tar- geted interventions. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=F5Em8ASCosV.
Curran Associates, Inc., 2021. URL https://proceedings.neurips.cc/paper/2021/file/d010396ca8abf6ead8cacc2c2f2f26c7-Paper.pdf.
Yangyi Lu, Amirhossein Meisami, Ambuj Tewari, and William Yan. Regret analysis of ban- dit problems with causal background knowledge. In Jonas Peters and David Sontag, editors, Proceedings of the 36th Conference on Uncertainty in Artificial Intelligence (UAI), volume 124 of Proceedings of Machine Learning Research, pages 141-150. PMLR, 03-06 Aug 2020. URL https://proceedings.mlr.press/v124/lu20a.html.
Virginia Aglietti, Xiaoyu Lu, Andrei Paleyes, and Javier González. Causal bayesian op- timization. In Silvia Chiappa and Roberto Calandra, editors, Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, volume 108 of Pro- ceedings of Machine Learning Research, pages 3155-3164. PMLR, 26-28 Aug 2020. URL https://proceedings.mlr.press/v108/aglietti20a.html.
Curran Associates, Inc., 2021. URL https://proceedings.neurips.cc/paper/2021/file/577bcc914f9e55d5e4e4f82f9f00e7d4-Paper.pdf.
Nihal Sharma, Soumya Basu, Karthikeyan Shanmugam, and Sanjay Shakkottai. Warm starting bandits with side information from confounded data. arXiv preprint arXiv:2002.08405, 2020. · arXiv
Curran Associates, Inc., 2021. URL https://proceedings.neurips.cc/paper/2021/file/b0b79da57b95837f14be95aaa4d54cf8-Paper.pdf.
Junzhe Zhang. Designing optimal dynamic treatment regimes: A causal reinforcement learning ap- proach. In Hal Daumé III and Aarti Singh, editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 11012-11022. PMLR, 13-18 Jul 2020. URL https://proceedings.mlr.press/v119/zhang20a.html.
Arquímides Méndez-Molina, Eduardo F.Morales, and L. Enrique Sucar. Causal discovery and reinforcement learning: A synergistic integration. In Antonio Salmerón and Rafael Rumi, edi- tors, Proceedings of The 11th International Conference on Probabilistic Graphical Models, volume 186 of Proceedings of Machine Learning Research, pages 421-432. PMLR, 05-07 Oct 2022. URL https://proceedings.mlr.press/v186/mendez-molina22a.html.
Clare Lyle, Amy Zhang, Minqi Jiang, Joelle Pineau, and Yarin Gal. Resolving causal confusion in rein- forcement learning via robust exploration. In Self-Supervision for Reinforcement Learning Workshop- ICLR 2021, 2021.
Curran Associates, Inc., 2021. URL https://proceedings.neurips.cc/paper/2021/file/c1722a7941d61aad6e651a35b65a9c3e-Paper.pdf.
Chao-Han Huck Yang, I Hung, Te Danny, Yi Ouyang, and Pin-Yu Chen. Causal inference q-network: Toward resilient reinforcement learning. arXiv preprint arXiv:2102.09677, 2021. · arXiv
Yangyi Lu, Amirhossein Meisami, and Ambuj Tewari. Efficient reinforcement learning with prior causal knowledge. In Bernhard Schölkopf, Caroline Uhler, and Kun Zhang, editors, Proceedings of the First Conference on Causal Learning and Reasoning, volume 177 of Pro- ceedings of Machine Learning Research, pages 526-541. PMLR, 11-13 Apr 2022. URL https://proceedings.mlr.press/v177/lu22a.html.
Mirco Mutti, Riccardo De Santi, Emanuele Rossi, Juan Felipe Calderon, Michael M. Bronstein, and Marcello Restelli. Provably efficient causal model-based reinforcement learning for environment- agnostic generalization. In A causal view on dynamical systems, NeurIPS 2022 workshop, 2022. URL https://openreview.net/forum?id=VDunku3bDk.
Tennison Liu, Zhaozhi Qian, Jeroen Berrevoets, and Mihaela van der Schaar. GOGGLE: Generative modelling for tabular data by learning relational structure. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=fPVRcJqspu.

Sorted by citations

Causal Inference Meets Deep Learning: A Comprehensive Survey
Jiao, L., Wang, Y., Liu, X., Li, L., Liu, F., Ma, W., Guo, Y., Chen, P., Yang, S., & Hou, B. (2024) · Research · doi:10.34133/research.0467 · Cited by 122 · see citing works
“Berrevoets et al. [67] introduced the concept of causal deep learning (CDL), described a practical framework for CDL in terms of structural, parameter, and temporal dimensions, and provided examples of applying CDL in the fields of healthcare, economics and business, environmental science, and…”
Background
Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging
Pahud de Mortanges, A., Luo, H., Shu, S. Z., Kamath, A., Suter, Y., Shelan, M., Pöllinger, A., & Reyes, M. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01190-w · Cited by 93 · see citing works
Deep learning for low-data drug discovery: Hurdles and opportunities
van Tilborg, D., Brinkmann, H., Criscuolo, E., Rossen, L., Özçelik, R., & Grisoni, F. (2024) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2024.102818 · Cited by 61 · see citing works
Shape modeling of longitudinal medical images: from diffeomorphic metric mapping to deep learning
Tay, E., Tümer, N., & ZADPOOR, A. A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1671099 · Cited by 1 · see citing works
“In recent years, several studies have explored extending SCMs towards being supported by DL ( i.e., Deep Structural Causal Models (DSCMs)), enabling the use of hidden features identified via DL [181–183].”

Authors: Berrevoets, J., Kacprzyk, K., Qian, Z., & van der Schaar, M.
Affiliations: University of Cambridge (GB)
ORCID: Berrevoets, Jeroen
Qian, Zhaozhi
Venue: arXiv
Publisher: arXiv
Published: 2023
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.2303.02186
arXiv: 2303.02186
OpenAlex: W4323547446
Cited by: 8
References: 139
Citations by year: 2025: 2 · 2024: 5 · 2023: 1
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: cc-by
creativecommons.org/licenses/by/4.0/legalcode
Locations: arXiv (Cornell University) (submittedVersion, cc-by)
arXiv (Cornell University) (cc-by)
Funders: Microsoft Research
King's College London
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords: causal inference, causal representation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Causal Deep Learning

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks