Efficient Transfer Entropy Analysis of Non-Stationary Neural Time Series
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these necessary observations, available estimators typically assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble of realizations is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that is suitable for the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method for transfer entropy estimation. We test the performance and robustness of our implementation on data from numerical simulations of stochastic processes. We also demonstrate the applicability of the ensemble method to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscience data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J.-M. (2011) · Computational Intelligence and Neuroscience · doi:10.1155/2011/156869 · Cited by 10,323
Nonparametric statistical testing of EEG- and MEG-data
Maris, E., & Oostenveld, R. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.03.024 · Cited by 8,496 · cited 1×
“This p-value is then compared to a critical alpha level (see for example [56,76]).”
ResultOn computable numbers, with an application to the entscheidungsproblem
Turing, A. M. (1937) · Proceedings of the London Mathematical Society · doi:10.1112/plms/s2-42.1.230 · Cited by 8,283
FAST APPROXIMATE NEAREST NEIGHBORS WITH AUTOMATIC ALGORITHM CONFIGURATION
(2009) · Proceedings of the Fourth International Conference on Computer Vision Theory and Applications · doi:10.5220/0001787803310340 · Cited by 2,640
Dynamic Brain Sources of Visual Evoked Responses
Makeig, S., Westerfield, M., Jung, T.-P., Enghoff, S., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2002) · Science · doi:10.1126/science.1066168 · Cited by 1,630
Computation at the edge of chaos: Phase transitions and emergent computation
Langton, C. G. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90064-v · Cited by 1,527
Top-down facilitation of visual recognition
Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., Hämäläinen, M. S., Marinkovic, K., Schacter, D. L., Rosen, B. R., et al. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507062103 · Cited by 1,489
Ding, M., Bressler, S. L., Yang, W., & Liang, H. (2000) · Biological Cybernetics · doi:10.1007/s004229900137 · Cited by 582
Information Flows in Causal Networks
AY, N., & POLANI, D. (2008) · Advances in Complex Systems · doi:10.1142/s0219525908001465 · Cited by 287 · cited 1×
“This has far reaching consequences for the interpretation of the two measures: The intervention inherent in Strong’s method places it somewhat closer to causal measures such as Ay and Polani’s causal information flow [47], whereas intervention-free TE has a clear interpretation as the information transfered in relatio…”
MethodGraphics processing unit (GPU) programming strategies and trends in GPU computing
Brodtkorb, A. R., Hagen, T. R., & Sætra, M. L. (2013) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2012.04.003 · Cited by 283 · cited 3×
“the GPU’s hardware architecture, before explaining the implementation in more detail (additionally, see [58,59,75]).”
BackgroundMethodInfluentialRoux, F., Wibral, M., Singer, W., Aru, J., & Uhlhaas, P. J. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5778-12.2013 · Cited by 169
Self-citationNeuroelectromagnetic correlates of perceptual closure processes
Grutzner, C., Uhlhaas, P. J., Genc, E., Kohler, A., Singer, W., & Wibral, M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5434-09.2010 · Cited by 77 · cited 7×
“This is in line with the fact that the most pronounced task-related differences in FFA activity were found at latencies w 200 ms previously [86].”
BackgroundMethodResultInfluentialSelf-citationReduced predictable information in brain signals in autism spectrum disorder
Gómez, C., Lizier, J. T., Schaum, M., Wollstadt, P., Grützner, C., Uhlhaas, P., Freitag, C. M., Schlitt, S., Bölte, S., Hornero, R., et al. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00009 · Cited by 59 · cited 2×
“While there is still a struggle to properly define information modification [6,7] and its proper measure [8–12], well established measures for (local active) information storage [13], information transfer [14], and its localization in time and space [15,16] exist, and are applied in neuroscience (for information stora…”
BackgroundSelf-citation
Cited by
Untangling cross-frequency coupling in neuroscience
Aru, J., Aru, J., Priesemann, V., Wibral, M., Lana, L., Pipa, G., Singer, W., & Vicente, R. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.08.002 · Cited by 608
Self-citationJIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems
Lizier, J. T. (2014) · Frontiers in Robotics and AI · doi:10.3389/frobt.2014.00011 · Cited by 390
Breakdown of local information processing may underlie isoflurane anesthesia effects
Wollstadt, P., Sellers, K. K., Rudelt, L., Priesemann, V., Hutt, A., Fröhlich, F., & Wibral, M. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005511 · Cited by 49
“In the present study we thus generated 500 surrogate data sets by permuting whole epochs of the target time series while leaving the order of source time course epochs unchanged (see [61] for a detailed account of surrogate testing).”
Self-citationChan, J. S., Wibral, M., Stawowsky, C., Brandl, M., Helbling, S., Naumer, M. J., Kaiser, J., & Wollstadt, P. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.631599 · Cited by 49
Self-citationModes of information flow in collective cohesion
Sattari, S., Basak, U. S., James, R. G., Perrin, L. W., Crutchfield, J. P., & Komatsuzaki, T. (2022) · Science Advances · doi:10.1126/sciadv.abj1720 · Cited by 17
Metadata
- Authors
- Wollstadt, P., Martínez-Zarzuela, M., Vicente, R., Díaz-Pernas, F. J., & Wibral, M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-28
- Volume
- 9
- Issue
- 7
- Pages
- e102833
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1997976387
- Cited by
- 133
- References
- 13
- FWCI
- 6.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.