The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Neural Granger Causality
Open accessAbstract
While most classical approaches to Granger causality detection assume linear dynamics, many interactions in real-world applications, like neuroscience and genomics, are inherently nonlinear. In these cases, using linear models may lead to inconsistent estimation of Granger causal interactions. We propose a class of nonlinear methods by applying structured multilayer perceptrons (MLPs) or recurrent neural networks (RNNs) combined with sparsity-inducing penalties on the weights. By encouraging specific sets of weights to be zero-in particular, through the use of convex group-lasso penalties-we can extract the Granger causal structure. To further contrast with traditional approaches, our framework naturally enables us to efficiently capture long-range dependencies between series either via our RNNs or through an automatic lag selection in the MLP. We show that our neural Granger causality methods outperform state-of-the-art nonlinear Granger causality methods on the DREAM3 challenge data. This data consists of nonlinear gene expression and regulation time courses with only a limited number of time points. The successes we show in this challenging dataset provide a powerful example of how deep learning can be useful in cases that go beyond prediction on large datasets. We likewise illustrate our methods in detecting nonlinear interactions in a human motion capture dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
New Introduction to Multiple Time Series Analysis
Lütkepohl, H. (2005) · Springer eBooks · doi:10.1007/978-3-540-27752-1 · Cited by 5,918
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762
Time series forecasting using a hybrid ARIMA and neural network model
Zhang, G. P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00702-0 · Cited by 4,428
Parikh, N., & Boyd, S. (2014) · Foundations and Trends® in Optimization · doi:10.1561/2400000003 · Cited by 4,102
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bühlmann, P., & van de Geer, S. (2011) · Springer Series in Statistics · doi:10.1007/978-3-642-20192-9 · Cited by 1,680
Sporns, O. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/8476.001.0001 · Cited by 1,580
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bhlmann, P., & van de Geer, S. (2011) · Cited by 1,527
Simon, N., Friedman, J., Hastie, T., & Tibshirani, R. (2013) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.681250 · Cited by 1,380
Distribution-Free Predictive Inference for Regression
Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., & Wasserman, L. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1307116 · Cited by 1,049
Gaussian Process Dynamical Models for Human Motion
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1167 · Cited by 1,020
Transfer entropy—a model-free measure of effective connectivity for the neurosciences
Vicente, R., Wibral, M., Lindner, M., & Pipa, G. (2011) · Journal of Computational Neuroscience · doi:10.1007/s10827-010-0262-3 · Cited by 1,014
Attention is not not Explanation
Wiegreffe, S., & Pinter, Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1002 · Cited by 966
New Introduction to Multiple Time Series Analysis
(2005) · Springer eBooks · doi:10.1007/3-540-27752-8 · Cited by 831
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2008) · Essays in Econometrics vol II: Collected Papers of Clive W. J. Granger · doi:10.1017/ccol052179207x.002 · Cited by 728
Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains
Billings, S. A. (2013) · CERN Document Server (European Organization for Nuclear Research) · Cited by 659
A Proximal Stochastic Gradient Method with Progressive Variance Reduction
Xiao, L., & Zhang, T. (2014) · SIAM Journal on Optimization · doi:10.1137/140961791 · Cited by 592
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2_2 · Cited by 545
Towards a rigorous assessment of systems biology models: the DREAM3 challenges
Prill, R. J., Marbach, D., Saez-Rodriguez, J., Sorger, P. K., Alexopoulos, L. G., Xue, X., Clarke, N. D., Altan-Bonnet, G., & Stolovitzky, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009202 · Cited by 439
Backpropagation: Theory, architectures, and applications
Biron, P. V. (1997) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199701)48:1<88::aid-asi10>3.0.co;2-# · Cited by 435
Training recurrent neural networks
Hinton, G. E., & Sutskever, I. (2013) · Cited by 383
Tree-Guided Group Lasso for Multi-Task Regression with Structured Sparsity
Kim, S., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6476414 · Cited by 374
Modelling Nonlinear Economic Time Series
Teräsvirta, T., Tjøstheim, D., & Granger, C. W. J. (2010) · doi:10.1093/acprof:oso/9780199587148.001.0001 · Cited by 352
Regularized estimation in sparse high-dimensional time series models
Basu, S., & Michailidis, G. (2015) · The Annals of Statistics · doi:10.1214/15-aos1315 · Cited by 345
Escaping the Curse of Dimensionality in Estimating Multivariate Transfer Entropy
Runge, J., Heitzig, J., Petoukhov, V., & Kurths, J. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.258701 · Cited by 345
A study of problems encountered in Granger causality analysis from a neuroscience perspective
Stokes, P. A., & Purdon, P. L. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1704663114 · Cited by 342
Learning Switching Linear Models of Human Motion
Pavlović, V., Rehg, J. M., & MacCormick, J. (2000) · Cited by 331
Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical SystemsPreprint
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01236 · Cited by 330
Bayesian Compression for Deep Learning
Louizos, C., Ullrich, K., & Welling, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08665 · Cited by 312
Style translation for human motion
Hsu, E., Pulli, K., & Popović, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073315 · Cited by 305
Learning with Structured Sparsity
Huang, J., Zhang, T., & Metaxas, D. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0903.3002 · Cited by 275
Proximal Methods for Hierarchical Sparse Coding
Jenatton, R., Mairal, J., Obozinski, G., & Bach, F. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.2139 · Cited by 272
Gong, P., Zhang, C., Lu, Z., Huang, J. Z., & Ye, J. (2013) · PubMed · doi:10.48550/arxiv.1303.4434 · Cited by 272
Koutník, J., Greff, K., Gomez, F. J., & Schmidhuber, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.3511 · Cited by 262
Neural networks for system identification
Chu, S. R., Shoureshi, R., & Tenorio, M. (1990) · IEEE Control Systems Magazine · doi:10.1109/37.55121 · Cited by 227
Kernel-Granger causality and the analysis of dynamical networks
Marinazzo, D., Pellicoro, M., & Stramaglia, S. (2008) · Physical Review E · doi:10.1103/physreve.77.056215 · Cited by 192
Discovering graphical Granger causality using the truncating lasso penalty
Shojaie, A., & Michailidis, G. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq377 · Cited by 183
Self-citationLearning with structured sparsity
Huang, J., Zhang, T., & Metaxas, D. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553429 · Cited by 182
Learning the Number of Neurons in Deep Networks
Álvarez, J. M., & Salzmann, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06321 · Cited by 164
Grouped graphical Granger modeling for gene expression regulatory networks discovery
Lozano, A. C., Abe, N., Liu, Y., & Rosset, S. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp199 · Cited by 159
Exploring Interpretable LSTM Neural Networks over Multi-Variable DataPreprint
Guo, T., Lin, T., & Antulov-Fantulin, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12034 · Cited by 156
On directed information theory and Granger causality graphs
Amblard, P., & Michel, O. (2010) · Journal of Computational Neuroscience · doi:10.1007/s10827-010-0231-x · Cited by 148
Inferring Dynamic Genetic Networks with Low Order Independencies
Lèbre, S. (2009) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1294 · Cited by 115
Neural Networks for System Identification
Chu, R., Shoureshi, R. A., & Tenorio, M. F. (1989) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.1989.4790321 · Cited by 113
Sparse-Input Neural Networks for High-dimensional Nonparametric Regression and ClassificationPreprint
Feng, J., & Simon, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07592 · Cited by 111
Long-term Forecasting using Tensor-Train RNNs
Yu, R., Zheng, S., Anandkumar, A., & Yue, Y. (2017) · CaltechAUTHORS (California Institute of Technology) · Cited by 103
Extracting neuronal functional network dynamics via adaptive Granger causality analysis
Sheikhattar, A., Miran, S., Liu, J., Fritz, J. B., Shamma, S., Kanold, P. O., & Babadi, B. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718154115 · Cited by 100
Please Stop Permuting Features: An Explanation and Alternatives.Preprint
Hooker, G., & Mentch, L. (2019) · arXiv (Cornell University) · Cited by 86
Operator-valued kernel-based vector autoregressive models for network inference
Lim, N., d’Alché–Buc, F., Auliac, C., & Michailidis, G. C. (2014) · Machine Learning · doi:10.1007/s10994-014-5479-3 · Cited by 57
Grouped graphical Granger modeling methods for temporal causal modeling
Lozano, A. C., Abe, N., Liu, Y., & Rosset, S. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557085 · Cited by 54
Inferring connectivity in networked dynamical systems: Challenges using Granger causality
Lusch, B., Maia, P. D., & Kutz, J. N. (2016) · Physical review. E · doi:10.1103/physreve.94.032220 · Cited by 48
An interpretable LSTM neural network for autoregressive exogenous modelPreprint
Guo, T., Lin, T., & Lu, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05251 · Cited by 43
Hierarchical Attention-Based Recurrent Highway Networks for Time Series PredictionPreprint
Tao, Y., Ma, L., Zhang, W., Liu, J., Liu, W., & Du, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00685 · Cited by 29
Fujita, A., Severino, P., Sato, J. R., & Miyano, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15060-9_2 · Cited by 21
Cited by
Granger Causality: A Review and Recent Advances
Shojaie, A., & Fox, E. B. (2022) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-040120-010930 · Cited by 556
Self-citationMachine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
Multiscale Modeling Meets Machine Learning: What Can We Learn?
Peng, G. C. Y., Alber, M., Buganza Tepole, A., Cannon, W. R., De, S., Dura-Bernal, S., Garikipati, K., Karniadakis, G., Lytton, W. W., Perdikaris, P., et al. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09405-5 · Cited by 353
Root Cause Analysis in Microservice Using Neural Granger Causal Discovery
Lin, C.-M., Chang, C., Wang, W.-Y., Wang, K.-D., & Peng, W.-C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i1.27772 · Cited by 39
Metadata
- Authors
- Tank, A., Covert, I., Foti, N., Shojaie, A., & Fox, E. B.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021
- Volume
- 44
- Issue
- 8
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3133777397
- Cited by
- 282
- References
- 61
- FWCI
- 25.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.