The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Escaping the Curse of Dimensionality in Estimating Multivariate Transfer Entropy
Abstract
Multivariate transfer entropy (TE) is a model-free approach to detect causalities in multivariate time series. It is able to distinguish direct from indirect causality and common drivers without assuming any underlying model. But despite these advantages it has mostly been applied in a bivariate setting as it is hard to estimate reliably in high dimensions since its definition involves infinite vectors. To overcome this limitation, we propose to embed TE into the framework of graphical models and present a formula that decomposes TE into a sum of finite-dimensional contributions that we call decomposed transfer entropy. Graphical models further provide a richer picture because they also yield the causal coupling delays. To estimate the graphical model we suggest an iterative algorithm, a modified version of the PC-algorithm with a very low estimation dimension. We present an appropriate significance test and demonstrate the method's performance using examples of nonlinear stochastic delay-differential equations and observational climate data (sea level pressure).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Synchronization a universal concept in nonlinear sciences
PIKOVSKY, A. S., Rosenblum, M. G., & Kurths, J. (2001) · Cited by 5,640
Self-citationCausation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Measuring Information Transfer
Schreiber, T. (2000) · Physical Review Letters · doi:10.1103/physrevlett.85.461 · Cited by 4,530
Lauritzen, S. L. (1996) · doi:10.1093/oso/9780198522195.001.0001 · Cited by 2,976
Testing for Linear and Nonlinear Granger Causality in the Stock Price‐Volume Relation
HIEMSTRA, C., & JONES, J. D. (1994) · The Journal of Finance · doi:10.1111/j.1540-6261.1994.tb04776.x · Cited by 1,487
Synchronization: Theory and Application
(2003) · doi:10.1007/978-94-010-0217-2 · Cited by 1,049
Causality detection based on information-theoretic approaches in time series analysis
HLAVACKOVASCHINDLER, K., PALUS, M., VEJMELKA, M., & BHATTACHARYA, J. (2007) · Physics Reports · doi:10.1016/j.physrep.2006.12.004 · Cited by 800
The backbone of the climate network
Donges, J. F., Zou, Y., Marwan, N., & Kurths, J. (2009) · EPL (Europhysics Letters) · doi:10.1209/0295-5075/87/48007 · Cited by 473
Self-citationKernel Method for Nonlinear Granger Causality
Marinazzo, D., Pellicoro, M., & Stramaglia, S. (2008) · Physical Review Letters · doi:10.1103/physrevlett.100.144103 · Cited by 400
Atmospheric Circulation Systems - Their Structure and Physical Interpretation
(1969) · International Geophysics · doi:10.1016/s0074-6142(08)x6048-6 · Cited by 355
Predicting Catastrophes in Nonlinear Dynamical Systems by Compressive Sensing
Wang, W.-X., Yang, R., Lai, Y.-C., Kovanis, V., & Grebogi, C. (2011) · Physical Review Letters · doi:10.1103/physrevlett.106.154101 · Cited by 352
Partial Mutual Information for Coupling Analysis of Multivariate Time Series
Frenzel, S., & Pompe, B. (2007) · Physical Review Letters · doi:10.1103/physrevlett.99.204101 · Cited by 348
Synchronization as adjustment of information rates: Detection from bivariate time series
Paluš, M., Komárek, V., Hrnčíř, Z., & Štěrbová, K. (2001) · Physical Review E · doi:10.1103/physreve.63.046211 · Cited by 336
Graphical interaction models for multivariate time series 1
Dahlhaus, R. (2000) · Metrika · doi:10.1007/s001840000055 · Cited by 335
Inferring the directionality of coupling with conditional mutual information
Vejmelka, M., & Paluš, M. (2008) · Physical Review E · doi:10.1103/physreve.77.026214 · Cited by 215
Ansell, T. J., Jones, P. D., Allan, R. J., Lister, D., Parker, D. E., Brunet, M., Moberg, A., Jacobeit, J., Brohan, P., Rayner, N. A., et al. (2006) · Journal of Climate · doi:10.1175/jcli3775.1 · Cited by 196
Graphical modelling of multivariate time series
Eichler, M. (2011) · Probability Theory and Related Fields · doi:10.1007/s00440-011-0345-8 · Cited by 158
Graphical modelling of multivariate time seriesPreprint
Eichler, M. (n.d.) · Cited by 132
Momentary information transfer as a coupling measure of time series
Pompe, B., & Runge, J. (2011) · Physical Review E · doi:10.1103/physreve.83.051122 · Cited by 103
Self-citationDistinguishing Direct from Indirect Interactions in Oscillatory Networks with Multiple Time Scales
Nawrath, J., Romano, M. C., Thiel, M., Kiss, I. Z., Wickramasinghe, M., Timmer, J., Kurths, J., & Schelter, B. O. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.038701 · Cited by 73
Self-citationPrusseit, J., & Lehnertz, K. (2008) · Physical Review E · doi:10.1103/physreve.77.041914 · Cited by 47
Estimating causal dependencies in networks of nonlinear stochastic dynamical systems
Sommerlade, L., Eichler, M., Jachan, M., Henschel, K., Timmer, J., & Schelter, B. O. (2009) · Physical Review E · doi:10.1103/physreve.80.051128 · Cited by 28
Cited by
Detecting and quantifying causal associations in large nonlinear time series datasets
Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., & Sejdinovic, D. (2019) · Science Advances · doi:10.1126/sciadv.aau4996 · Cited by 979
Self-citationInfluence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701
Granger Causality: A Review and Recent Advances
Shojaie, A., & Fox, E. B. (2022) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-040120-010930 · Cited by 556
Causal network reconstruction from time series: From theoretical assumptions to practical estimation
Runge, J. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5025050 · Cited by 422
Self-citationSignal propagation in complex networks
Ji, P., Ye, J., Mu, Y., Lin, W., Tian, Y., Hens, C., Perc, M., Tang, Y., Sun, J., & Kurths, J. (2023) · Physics Reports · doi:10.1016/j.physrep.2023.03.005 · Cited by 360
Self-citation
Metadata
- Authors
- Runge, J., Heitzig, J., Petoukhov, V., & Kurths, J.
- Venue
- Physical Review Letters
- Publisher
- American Physical Society (APS)
- Published
- 2012-06-21
- Volume
- 108
- Issue
- 25
- Pages
- 258701-258701
- ISSN
- 0031-9007 (ISSN-L)
- 1079-7114
- OpenAlex
- W2326655560
- Cited by
- 345
- References
- 26
- FWCI
- 54.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.