The DOI matches its Crossref record; 78 of the 80 references it cites were found in a registry or an index.
Causal discovery and inference: concepts and recent methodological advances
Open accessAbstract
This paper aims to give a broad coverage of central concepts and principles involved in automated causal inference and emerging approaches to causal discovery from i.i.d data and from time series. After reviewing concepts including manipulations, causal models, sample predictive modeling, causal predictive modeling, and structural equation models, we present the constraint-based approach to causal discovery, which relies on the conditional independence relationships in the data, and discuss the assumptions underlying its validity. We then focus on causal discovery based on structural equations models, in which a key issue is the identifiability of the causal structure implied by appropriately defined structural equation models: in the two-variable case, under what conditions (and why) is the causal direction between the two variables identifiable? We show that the independence between the error term and causes, together with appropriate structural constraints on the structural equation, makes it possible. Next, we report some recent advances in causal discovery from time series. Assuming that the causal relations are linear with nonGaussian noise, we mention two problems which are traditionally difficult to solve, namely causal discovery from subsampled data and that in the presence of confounding time series. Finally, we list a number of open questions in the field of causal discovery and inference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1988) · Cited by 16,582
Sims, C. A. (1980) · Econometrica · doi:10.2307/1912017 · Cited by 12,841
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Independent Component Analysis
Hyvärinen, A., Hoyer, P. O., & Inki, M. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,938
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,865
Independent Component Analysis
Hyvärinen, A., Karhunen, J., & Erkki Oja, A. (2001) · Wiley eBooks · doi:10.1002/0471221317 · Cited by 5,003
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C., & Pearl, J. (2001) · The Philosophical Review · doi:10.2307/3182612 · Cited by 4,827
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Self-citationCausation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Self-citationCausality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,968
Mathematical Statistics: Basic Ideas and Selected Topics.
Wachter, K. W., Bickel, P. J., & Doksum, K. A. (1979) · Journal of the American Statistical Association · doi:10.2307/2286373 · Cited by 1,886
Granger, C. W. J. (1980) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(80)90069-x · Cited by 1,746
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A. J., & Schölkopf, B. (2005) · Lecture notes in computer science · doi:10.1007/11564089_7 · Cited by 1,668
(1988) · doi:10.1016/b978-0-08-051489-5.50008-4 · Cited by 1,429
A Linear Non-Gaussian Acyclic Model for Causal Discovery
Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006) · Cited by 1,152
Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI 2010)
Adams, R. P., Dahl, G. E., & Murray, I. (2010) · Cited by 966
An Algorithm for Fast Recovery of Sparse Causal Graphs
Spirtes, P., & Glymour, C. (1991) · Social Science Computer Review · doi:10.1177/089443939100900106 · Cited by 956
Self-citationTesting for Causality: A Personal Viewpoint
Granger, C. W. J. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511753978.003 · Cited by 747
Characterization Problems in Mathematical Statistics.
Ord, J. K., Kagan, A., Linnik, Y. V., Rao, C. R., & Ramachandran, B. (1975) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2345228 · Cited by 658
Nonlinear causal discovery with additive noise models
Hoyer, P. O., Janzing, D., Mooij, J. M., Peters, J., & Schölkopf, B. (2008) · Cited by 652
Bayesian Online Changepoint Detection
Adams, R. P., & MacKay, D. J. C. (2007) · arXiv · doi:10.48550/arxiv.0710.3742 · Cited by 601
Nonlinear independent component analysis: Existence and uniqueness results
Hyvärinen, A., & Pajunen, P. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00140-3 · Cited by 570
Richardson, T., & Spirtes, P. (2002) · The Annals of Statistics · doi:10.1214/aos/1031689015 · Cited by 545
Self-citationIndependence properties of directed markov fields
Lauritzen, S. L., Dawid, A. P., Larsen, B., & Leimer, H.-G. (1990) · Networks · doi:10.1002/net.3230200503 · Cited by 513
Random Variables and Probability Distributions
Nussbaum, E. M. (2014) · Routledge eBooks · doi:10.4324/9780203122860-10 · Cited by 439
Domain Adaptation under Target and Conditional Shift
Zhang, K., Schölkopf, B., Muandet, K., & Wang, Z. (2013) · Cited by 431
Self-citationSource separation in post-nonlinear mixtures
Taleb, A., & Jutten, C. (1999) · IEEE Transactions on Signal Processing · doi:10.1109/78.790661 · Cited by 430
DirectLiNGAM: A direct method for learning a linear non-gaussian structural equation model
Shimizu, S., Inazumi, T., Sogawa, Y., Hyvärinen, A., Kawahara, Y., Washio, T., Hoyer, P. O., & Bollen, K. A. (2013) · Cited by 399
Kernel-based Conditional Independence Test and Application in Causal DiscoveryPreprint
Zhang, K., Peters, J., Janzing, D., & Schölkopf, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3775 · Cited by 373
Self-citationInformation-geometric approach to inferring causal directions
Janzing, D., Mooij, J. M., Zhang, K., Lemeire, J., Jakob Zscheischler, A., Daniušis, P., Steudel, B., & Schölkopf, B. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2012.01.002 · Cited by 259
Self-citationEstimation of a Structural Vector Autoregression Model Using Non-Gaussianity
Hyvärinen, A., Zhang, K., Shimizu, S., & Hoyer, P. O. (2010) · doi:10.5555/1756006.1859907 · Cited by 259
Self-citationCharacterization Problems in Mathematical Statistics.
Laha, R. G., Kagan, A. M., Linnik, Y. V., & Rao, C. R. (1975) · Journal of the American Statistical Association · doi:10.2307/2285965 · Cited by 249
On the Identifiability of the Post-Nonlinear Causal ModelPreprint
Zhang, K., & Hyvärinen, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2599 · Cited by 229
Self-citationOn causal and anticausal learning
Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., Mooij, J. M., & Schölkopf, B. (2012) · International Conference on Machine Learning · Cited by 214
Self-citationRandom Variables and Probability Distributions
Cramér, H. (1970) · Cambridge University Press eBooks · doi:10.1017/cbo9780511470936 · Cited by 205
Causal Inference in the Presence of Latent Variables and Selection BiasPreprint
Spirtes, P., Meek, C., & Richardson, T. S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4983 · Cited by 199
Self-citationStrong Completeness and Faithfulness in Bayesian Networks
Meek, C. (2013) · arXiv · doi:10.48550/arxiv.1302.4973 · Cited by 194
Estimation of causal effects using linear non-Gaussian causal models with hidden variables
Hoyer, P. O., Shimizu, S., Kerminen, A., & Palviainen, M. (2008) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2008.02.006 · Cited by 172
Multi-Source Domain Adaptation: A Causal View
Zhang, K., Gong, M., & Schölkopf, B. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9542 · Cited by 146
Self-citationCausal Inference in Time Series Analysis
Eichler, M. (2012) · Wiley series in probability and statistics · doi:10.1002/9781119945710.ch22 · Cited by 146
Inferring deterministic causal relationsPreprint
Daniušis, P., Janzing, D., Mooij, J. M., Jakob Zscheischler, A., Steudel, B., Zhang, K., & Schölkopf, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.3475 · Cited by 124
Self-citationA Correspondence Principle for Simultaneous Equation Models
Fisher, F. M. (1970) · Econometrica · doi:10.2307/1909242 · Cited by 116
Constraint-based Causal Discovery from Multiple Interventions over Overlapping Variable SetsPreprint
TriantafillouSofia, & TsamardinosIoannis (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.2150 · Cited by 102
Talih, M., & Hengartner, N. (2005) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2005.00504.x · Cited by 97
Eberhardt, F., Glymour, C., & Scheines, R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.1389 · Cited by 91
Causal Inference of Ambiguous Manipulations
Spirtes, P., & Scheines, R. (2004) · Philosophy of Science · doi:10.1086/425058 · Cited by 88
Self-citationProbabilistic latent variable models for distinguishing between cause and effect
Stegle, O., Janzing, D., Zhang, K., Mooij, J. M., & Schölkopf, B. (2010) · neural information processing systems · Cited by 88
Self-citationTREK SEPARATION FOR GAUSSIAN GRAPHICAL MODELS
Sullivant, S., Talaska, K., & Draisma, J. J. (2008) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 80
Identifiability of Causal Graphs using Functional ModelsPreprint
Peters, J., Mooij, J. M., Janzing, D., & Schölkopf, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3757 · Cited by 70
Discovering Cyclic Causal Models with Latent Variables: A General SAT-Based ProcedurePreprint
Hyttinen, A., Hoyer, P. O., Eberhardt, F., & Järvisalo, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.6836 · Cited by 64
Missing Observations in the Dynamic Regression Model
Palm, F. C., & Nijman, T. E. (1984) · Econometrica · doi:10.2307/1913513 · Cited by 57
On Causal Discovery with Cyclic Additive Noise Models
Mooij, J. M., Janzing, D., Heskes, T., & Schölkopf, B. (2011) · MPG.PuRe (Max Planck Society) · Cited by 56
Discovering Temporal Causal Relations from Subsampled Data
Gong, M., Zhang, K., Schölkopf, B., Tao, D., & Geiger, P. (2015) · MPG.PuRe (Max Planck Society) · Cited by 50
Self-citationTrek separation for Gaussian graphical models
Sullivant, S., Talaska, K., & Draisma, J. (2010) · The Annals of Statistics · doi:10.1214/09-aos760 · Cited by 50
Causal Inference by Identification of Vector Autoregressive Processes with Hidden ComponentsPreprint
Geiger, P., Zhang, K., Gong, M., Janzing, D., & Schölkopf, B. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.3972 · Cited by 49
Self-citationIdentifying Cause and Effect on Discrete Data using Additive Noise Models
Peters, J., Janzing, D., & Schölkopf, B. (2010) · Cited by 47
Nonlinear directed acyclic structure learning with weakly additive noise models
Gretton, A., Spirtes, P., & Tillman, R. E. (2009) · neural information processing systems · Cited by 44
Self-citationOn Estimation of Functional Causal Models
Zhang, K., Wang, Z., Zhang, J., & Schölkopf, B. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2700476 · Cited by 42
Self-citationRandom Variables and Probability Distributions.
Kendall, D. G., & Cramer, H. L. (1971) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2344250 · Cited by 40
N-1 Experiments Suffice to Determine the Causal Relations Among N Variables
Eberhardt, F., Glymour, C., & Scheines, R. (2006) · Springer eBooks · doi:10.1007/3-540-33486-6_4 · Cited by 37
Learning Causal Structure from Undersampled Time Series
Danks, D., & Plis, S. (2018) · Figshare · doi:10.1184/r1/6492101 · Cited by 37
Yoo, C., & Cooper, G. F. (2004) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.01.018 · Cited by 33
Extensions of ICA for Causality Discovery in the Hong Kong Stock Market
Zhang, K., & Chan, L. (2006) · Lecture notes in computer science · doi:10.1007/11893295_45 · Cited by 32
Self-citationCausality Discovery with Additive Disturbances: An Information-Theoretical Perspective
Zhang, K., & Hyvärinen, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_37 · Cited by 32
Self-citationCausal Clustering for 2-Factor Measurement Models
Kummerfeld, E., Ramsey, J., Yang, R., Spirtes, P., & Scheines, R. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44851-9_3 · Cited by 24
Self-citationICA with Sparse Connections: Revisited
Zhang, K., Peng, H., Chan, L., & Hyvärinen, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00599-2_25 · Cited by 23
Self-citationA Bayesian Method for Causal Modeling and Discovery Under SelectionPreprint
Cooper, G. F. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3844 · Cited by 22
Learning the Causal Structure of Overlapping Variable Sets
Danks, D. J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36182-0_17 · Cited by 20
Factorizing Multivariate Function Classes
Lin, J. K. (1997) · Cited by 19
Identification of Time-Dependent Causal Model: a gaussian process treatment
Huang, B., Zhang, K., & Schölkopf, B. (2015) · MPG.PuRe (Max Planck Society) · Cited by 16
Self-citationTracking Time-varying Graphical Structure
Kummerfeld, E., & Danks, D. J. (2018) · KiltHub Repository · doi:10.1184/r1/6492992 · Cited by 13
Calculation of Entailed Rank Constraints in Partially Non-Linear and Cyclic ModelsPreprint
Spirtes, P. (2013) · arXiv (Cornell University) · doi:10.1184/r1/6491042 · Cited by 13
Self-citationDistinguishing Cause from Effect Based on ExogeneityPreprint
Zhang, K., Zhang, J., & Schölkopf, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.05651 · Cited by 12
Self-citationCalculation of Entailed Rank Constraints in Partially Non-Linear and Cyclic ModelsPreprint
Spirtes, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.7004 · Cited by 10
Self-citationYoo, C., Cooper, G. F., & Schmidt, M. C. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.05.011 · Cited by 9
Discovery and Visualization of Nonstationary Causal ModelsPreprint
Zhang, K., Huang, B., Zhang, J., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.08056 · Cited by 6
Self-citationTowards Robust and Specific Causal Discovery from fMRI.Preprint
Zhang, K., Huang, B., Schölkopf, B., Besserve, M., Watanabe, M., & Zhu, D. (2015) · arXiv (Cornell University) · Cited by 3
Self-citation
Research works printed but not linked: 3
- Cooper GF (1995) Causal discovery from data in the presence of selection bias. In: Fifth International Workshop on AI and Statistics, p 140–150
- Lacerda G, Spirtes P, Ramsey J, Hoyer PO (2008) Discovering cyclic causal models by independent components analysis. In: Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence (UAI2008), Helsinki
- Zhang K, Hyvärinen A (2010) Distinguishing causes from effects using nonlinear acyclic causal models. In: JMLR Workshop and Conference Proceedings, Presented at NIPS 2008 workshop on causality. 6:157–164
Cited by
Sorted by citations
Inferring causation from time series in Earth system sciences
Runge, J., Bathiany, S., Bollt, E. M., Camps‐Valls, G., Coumou, D., Deyle, E. R., Glymour, C., Kretschmer, M., Mahecha, M. D., Muñoz-Marı́, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-10105-3 · Cited by 1,093
Self-citationDetecting and quantifying causal associations in large nonlinear time series datasets
Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., & Sejdinovic, D. (2019) · Science Advances · doi:10.1126/sciadv.aau4996 · Cited by 979
Detecting and quantifying causal associations in large nonlinear time series datasets
Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., & Sejdinović, D. (2019) · Publication Database PIK (Potsdam Institute for Climate Impact Research (PIK)) · Cited by 713
Causal network reconstruction from time series: From theoretical assumptions to practical estimation
Runge, J. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5025050 · Cited by 422
A Survey of Learning Causality with Data: Problems and Methods
Guo, R., Cheng, L., Li, J., Hahn, P. R., & Liu, H. (2021) · ACM Computing Surveys · doi:10.1145/3397269 · Cited by 362
Metadata
- Authors
- Spirtes, P., & Zhang, K.
- Affiliations
- Carnegie Mellon University (US)
- Max Planck Institute for Intelligent Systems (DE)
- Corresponding author
- Zhang, Kun
- Venue
- Applied Informatics
- Published
- 2016-02-18
- Volume
- 3
- Issue
- 1
- Pages
- 3-3
- ISSN
- 2196-0089 (ISSN-L)
- PMC
- PMC4841209
- OpenAlex
- W2297288734
- Cited by
- 304
- References
- 80
- Citations by year
- 2026: 19 · 2025: 37 · 2024: 32 · 2023: 40 · 2022: 24 · 2021: 42 · 2020: 40 · 2019: 24 · 2018: 25 · 2017: 17 · 2016: 4
- FWCI
- 3.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Applied Informatics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Science Foundation (1317428)
- National Institutes of Health
- National Human Genome Research Institute (U54HG008540)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- causal discovery, causal inference, constraint-based causal discovery, conditional independence, causal models, structural equation modeling, confounding, non-Gaussian noise
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
