The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables
Open accessAbstract
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Horn, R. A., & Johnson, C. R. (1985) · Cited by 22,203
Probability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,226
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Horn, R. A., & Johnson, C. R. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810817 · Cited by 10,280
Density Estimation for Statistics and Data Analysis
(1986) · Springer eBooks · doi:10.1007/978-1-4899-3324-9 · Cited by 8,525
Probability, Random Variables, and Stochastic Processes
Miller, I. (1966) · Technometrics · doi:10.1080/00401706.1966.10490365 · Cited by 8,452
The Advanced Theory of Statistics.
Clarke, G. M., Kendall, M., & Stuart, A. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344782 · Cited by 6,658
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Cited by
The MVGC multivariate Granger causality toolbox: A new approach to Granger-causal inference
Barnett, L., & Seth, A. K. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.10.018 · Cited by 1,044
Self-citationThe physics of higher-order interactions in complex systems
Battiston, F., Amico, E., Barrat, A., Bianconi, G., Ferraz de Arruda, G., Franceschiello, B., Iacopini, I., Kéfi, S., Latora, V., Moreno, Y., et al. (2021) · Nature Physics · doi:10.1038/s41567-021-01371-4 · Cited by 932
Granger causality analysis in neuroscience and neuroimaging
Seth, A. K., Barrett, A. B., & Barnett, L. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4399-14.2015 · Cited by 928
“DOI:10.1523/JNEUROSCI.4399-14.2015 Copyright © 2015 the authors 0270-6474/15/353293-05$15.00/0 pendency or shared information between two variables (Barnett et al., 2009).”
InfluentialSelf-citationWiener–Granger Causality: A well established methodology
Bressler, S. L., & Seth, A. K. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.059 · Cited by 847
Self-citationA MATLAB toolbox for Granger causal connectivity analysis
Seth, A. K. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.11.020 · Cited by 750
Self-citationFarahani, F. V., Karwowski, W., & Lighthall, N. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00585 · Cited by 718
Analysing connectivity with Granger causality and dynamic causal modelling
Friston, K., Moran, R., & Seth, A. K. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.010 · Cited by 684
Self-citationTsimring, L. S. (2014) · Reports on Progress in Physics · doi:10.1088/0034-4885/77/2/026601 · Cited by 452
Causal network reconstruction from time series: From theoretical assumptions to practical estimation
Runge, J. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5025050 · Cited by 422
“A more general definition is that of (bivariate) transfer entropy (Schreiber, 2000; Barnett et al., 2009) ITEbivX→Y = I(X−t ; Yt | Y−t ), (2) where I(X ; Y | Z) denotes the conditional mutual information (CMI).”
BackgroundUnraveling the cause-effect relation between time series
Liang, X. S. (2014) · Physical Review E · doi:10.1103/physreve.90.052150 · Cited by 409
JIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems
Lizier, J. T. (2014) · Frontiers in Robotics and AI · doi:10.3389/frobt.2014.00011 · Cited by 390
Ince, R. A. A., Giordano, B. L., Kayser, C., Rousselet, G. A., Gross, J., & Schyns, P. G. (2017) · Human Brain Mapping · doi:10.1002/hbm.23471 · Cited by 366
Signal propagation in complex networks
Ji, P., Ye, J., Mu, Y., Lin, W., Tian, Y., Hens, C., Perc, M., Tang, Y., Sun, J., & Kurths, J. (2023) · Physics Reports · doi:10.1016/j.physrep.2023.03.005 · Cited by 360
Babiloni, C., Lizio, R., Marzano, N., Capotosto, P., Soricelli, A., Triggiani, A. I., Cordone, S., Gesualdo, L., & Del Percio, C. (2016) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.02.008 · Cited by 359
Buzsáki, G. (2019) · doi:10.1093/oso/9780190905385.001.0001 · Cited by 358
A study of problems encountered in Granger causality analysis from a neuroscience perspective
Stokes, P. A., & Purdon, P. L. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1704663114 · Cited by 342
A systematic framework for functional connectivity measures
Wang, H. E., Bénar, C. G., Quilichini, P. P., Friston, K. J., Jirsa, V. K., & Bernard, C. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00405 · Cited by 327
Lobier, M., Siebenhühner, F., Palva, S., & Palva, J. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.056 · Cited by 302
Data based identification and prediction of nonlinear and complex dynamical systems
Wang, W.-X., Lai, Y.-C., & Grebogi, C. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.06.004 · Cited by 299
Use and abuse of correlation analyses in microbial ecology
Carr, A., Diener, C., Baliga, N. S., & Gibbons, S. M. (2019) · The ISME Journal · doi:10.1038/s41396-019-0459-z · Cited by 289
Measuring Information-Transfer Delays
Wibral, M., Pampu, N., Priesemann, V., Siebenhühner, F., Seiwert, H., Lindner, M., Lizier, J. T., & Vicente, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055809 · Cited by 286
On the causal structure between CO2 and global temperature
Stips, A., Macias, D., Coughlan, C., Garcia-Gorriz, E., & Liang, X. S. (2016) · Scientific Reports · doi:10.1038/srep21691 · Cited by 284
Multivariate Granger causality and generalized variance
Barrett, A. B., Barnett, L., & Seth, A. K. (2010) · Physical Review E · doi:10.1103/physreve.81.041907 · Cited by 264
Self-citationFaes, L., Nollo, G., & Porta, A. (2011) · Physical Review E · doi:10.1103/physreve.83.051112 · Cited by 253
Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals
Stetter, O., Battaglia, D., Soriano, J., & Geisel, T. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002653 · Cited by 252
Practical Measures of Integrated Information for Time-Series Data
Barrett, A. B., & Seth, A. K. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001052 · Cited by 225
Self-citationInformation decomposition and the informational architecture of the brain
Luppi, A. I., Rosas, F. E., Mediano, P. A. M., Menon, D. K., & Stamatakis, E. A. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.11.005 · Cited by 140
Measuring integrated information: comparison of candidate measures in theory and simulation
Mediano, P., Seth, A., & Barrett, A. (2018) · Entropy · doi:10.3390/e21010017 · Cited by 145
“omplexity literature. CD was originally dened in terms of Granger causality [18], but here we write it in terms of Transfer Entropy (TE) which provides a more general information-theoretic denition [6]. The conditional transfer entropy from Xto Y conditioned on Zis dened as TE˝(X!YjZ) =: I(Xt;Yt+˝jZt;Yt) : (30) With t…”
BackgroundSelf-citationSerotonergic psychedelics temporarily modify information transfer in humans.
Alonso, J. F., Romero, S., Mañanas, M. À., & Riba, J. (2015) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyv039 · Cited by 101
Reciprocity and alignment: quantifying coupling in dynamic interactions
Dumas, G., & Fairhurst, M. T. (2021) · Royal Society Open Science · doi:10.1098/rsos.210138 · Cited by 88
“54 From a clinical perspective, a great deal of work continues to be done studying deficits in autism to advance our knowledge of sensorimotor coupling, that is more adaptive reciprocal exchanges.”
BackgroundHow to detect the Granger-causal flow direction in the presence of additive noise?
Vinck, M., Huurdeman, L., Bosman, C. A., Fries, P., Battaglia, F. P., Pennartz, C. M. A., & Tiesinga, P. H. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.017 · Cited by 77
Solved problems for Granger causality in neuroscience: A response to Stokes and Purdon
Barnett, L., Barrett, A. B., & Seth, A. K. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.067 · Cited by 73
“, 2011) and—as explained above—making inferences about directed information flow (GGC; Barnett et al., 2009).”
Self-citationStress-sensitive inference of task controllability
Ligneul, R., Mainen, Z. F., Ly, V., & Cools, R. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01306-w · Cited by 60
Olcese, U., Bos, J. J., Vinck, M., & Pennartz, C. M. A. (2018) · Sleep · doi:10.1093/sleep/zsy167 · Cited by 18
Synergistic information transfer in the global system of financial markets
Scagliarini, T., Faes, L., Marinazzo, D., Stramaglia, S., & Mantegna, R. N. (2020) · Entropy · doi:10.3390/e22091000 · Cited by 16
Multi-indicators prediction in microservice using Granger causality test and Attention LSTM
Ji, S., Wu, W., & Pu, Y. (2020) · 2020 IEEE World Congress on Services (SERVICES) · doi:10.1109/services48979.2020.00030 · Cited by 8
On the impact of publicly available news and information transfer to financial markets
Jazbec, M., Pàsztor, B., Faltings, F., Antulov-Fantulin, N., & Kolm, P. N. (2021) · Royal Society Open Science · doi:10.1098/rsos.202321 · Cited by 3
Metadata
- Authors
- Barnett, L., Barrett, A. B., & Seth, A. K.
- Venue
- Physical Review Letters
- Publisher
- American Physical Society (APS)
- Published
- 2009-12-04
- Volume
- 103
- Issue
- 23
- Pages
- 238701-238701
- ISSN
- 0031-9007 (ISSN-L)
- 1079-7114
- OpenAlex
- W2079656335
- Cited by
- 1,139
- References
- 30
- FWCI
- 48.08
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.