The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
A systematic framework for functional connectivity measures
Open accessAbstract
Various methods have been proposed to characterize the functional connectivity between nodes in a network measured with different modalities (electrophysiology, functional magnetic resonance imaging etc.). Since different measures of functional connectivity yield different results for the same dataset, it is important to assess when and how they can be used. In this work, we provide a systematic framework for evaluating the performance of a large range of functional connectivity measures-based upon a comprehensive portfolio of models generating measurable responses. Specifically, we benchmarked 42 methods using 10,000 simulated datasets from 5 different types of generative models with different connectivity structures. Since all functional connectivity methods require the setting of some parameters (window size and number, model order etc.), we first optimized these parameters using performance criteria based upon (threshold free) ROC analysis. We then evaluated the performance of the methods on data simulated with different types of models. Finally, we assessed the performance of the methods against different levels of signal-to-noise ratios and network configurations. A MATLAB toolbox is provided to perform such analyses using other methods and simulated datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., & Raichle, M. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504136102 · Cited by 8,553
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
Application of the cross wavelet transform and wavelet coherence to geophysical time series
Grinsted, A., Moore, J. C., & Jevrejeva, S. (2004) · Nonlinear Processes in Geophysics · doi:10.5194/npg-11-561-2004 · Cited by 6,285
Friston, K. J., Harrison, L., & Penny, W. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00202-7 · Cited by 4,583
Self-citationMeasuring Information Transfer
Schreiber, T. (2000) · Physical Review Letters · doi:10.1103/physrevlett.85.461 · Cited by 4,530
Thirteen Ways to Look at the Correlation Coefficient
Lee Rodgers, J., & Nicewander, W. A. (1988) · The American Statistician · doi:10.1080/00031305.1988.10475524 · Cited by 4,052
The economy of brain network organization
Bullmore, E., & Sporns, O. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3214 · Cited by 3,284
A two-dimensional mapping with a strange attractor
Hénon, M. (1976) · Communications in Mathematical Physics · doi:10.1007/bf01608556 · Cited by 2,987
Functional and effective connectivity in neuroimaging: a synthesis
Friston, K. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020107 · Cited by 2,452
Self-citationMeasurement of Linear Dependence and Feedback between Multiple Time Series
Geweke, J. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477803 · Cited by 2,060
Network modelling methods for FMRI
Smith, S. M., Miller, K. L., Salimi-Khorshidi, G., Webster, M., Beckmann, C. F., Nichols, T. E., Ramsey, J. D., & Woolrich, M. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.08.063 · Cited by 1,878
Partial directed coherence: a new concept in neural structure determination
Baccalá, L. A., & Sameshima, K. (2001) · Biological Cybernetics · doi:10.1007/pl00007990 · Cited by 1,779
Jansen, B. H., & Rit, V. G. (1995) · Biological Cybernetics · doi:10.1007/bf00199471 · Cited by 1,159 · cited 1×
“We chose to include neurally motivated models [NMM from Jansen-Rit (Jansen and Rit, 1995), fMRI from Ballon-Windkessel (Friston et al., 2003)], and well-investigated dynamic models with no direct reference to neural systems (Rössler, Hénon, linear stochastic system).”
MethodGranger Causality and Transfer Entropy Are Equivalent for Gaussian Variables
Barnett, L., Barrett, A. B., & Seth, A. K. (2009) · Physical Review Letters · doi:10.1103/physrevlett.103.238701 · Cited by 1,139
Nonlinear multivariate analysis of neurophysiological signals
Pereda, E., Quiroga, R. Q., & Bhattacharya, J. (2005) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2005.10.003 · Cited by 1,076
A new method of the description of the information flow in the brain structures
Kaminski, M. J., & Blinowska, K. J. (1991) · Biological Cybernetics · doi:10.1007/bf00198091 · Cited by 1,047
Kamiński, M., Ding, M., Truccolo, W. A., & Bressler, S. L. (2001) · Biological Cybernetics · doi:10.1007/s004220000235 · Cited by 996
Structural equation modeling and its application to network analysis in functional brain imaging
McLntosh, A. R., & Gonzalez‐Lima, F. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020104 · Cited by 849
Quian Quiroga, R., Kraskov, A., Kreuz, T., & Grassberger, P. (2002) · Physical Review E · doi:10.1103/physreve.65.041903 · Cited by 841
Measures of Conditional Linear Dependence and Feedback between Time Series
Geweke, J. F. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477110 · Cited by 768
A MATLAB toolbox for Granger causal connectivity analysis
Seth, A. K. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.11.020 · Cited by 750
Friston, K. J., Kahan, J., Biswal, B., & Razi, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.009 · Cited by 553
Self-citationNONLINEAR TIME SEQUENCE ANALYSIS
GRASSBERGER, P., SCHREIBER, T., & SCHAFFRATH, C. (1991) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127491000403 · Cited by 526
Comparing hemodynamic models with DCM
Stephan, K. E., Weiskopf, N., Drysdale, P. M., Robinson, P. A., & Friston, K. J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.040 · Cited by 441 · cited 2×
“The neuronal signals were generated using linear differential equations with one neuronal state per node (Friston et al., 2003; Stephan et al., 2007) as shown in Supplementary Figure 2.”
MethodSelf-citationKorzeniewska, A., Mańczak, M., Kamiński, M., Blinowska, K. J., & Kasicki, S. (2003) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(03)00052-9 · Cited by 375
CONTINUOUS CHAOS—FOUR PROTOTYPE EQUATIONS
Rössler, O. E. (1979) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1979.tb29482.x · Cited by 373
Evaluation of different measures of functional connectivity using a neural mass model
David, O., Cosmelli, D., & Friston, K. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.006 · Cited by 339
Self-citationSynchronization as adjustment of information rates: Detection from bivariate time series
Paluš, M., Komárek, V., Hrnčíř, Z., & Štěrbová, K. (2001) · Physical Review E · doi:10.1103/physreve.63.046211 · Cited by 336
Neural masses and fields in dynamic causal modeling
Moran, R., Pinotsis, D. A., & Friston, K. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00057 · Cited by 255 · cited 11×
“We considered synaptic convolution-based neural mass models (NMM) in order to test the methods at the millisecond timescale, which is typical of EEG signals.”
MethodInfluentialSelf-citationGeneralized Partial Directed Coherence
Baccala, L. A., Sameshima, K., & Takahashi, D. Y. (2007) · 2007 15th International Conference on Digital Signal Processing · doi:10.1109/icdsp.2007.4288544 · Cited by 252
Receiver Operating Characteristic
Tan, P.-N. (2016) · Encyclopedia of Database Systems · doi:10.1007/978-1-4899-7993-3_569-2 · Cited by 223
Wendling, F., Bartolomei, F., Bellanger, J. J., & Chauvel, P. (2001) · Clinical Neurophysiology · doi:10.1016/s1388-2457(01)00547-8 · Cited by 204
From EEG signals to brain connectivity: A model-based evaluation of interdependence measures
Wendling, F., Ansari-Asl, K., Bartolomei, F., & Senhadji, L. (2009) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.04.021 · Cited by 203
Lopes da Silva, F., Pijn, J. P., & Boeijinga, P. (1989) · Brain Topography · doi:10.1007/bf01128839 · Cited by 190
Hinich, M. J., & Clay, C. S. (1968) · Reviews of Geophysics · doi:10.1029/rg006i003p00347 · Cited by 175
On the spectral formulation of Granger causality
Chicharro, D. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0469-z · Cited by 118
Ansari-Asl, K., Senhadji, L., Bellanger, J.-J., & Wendling, F. (2006) · Physical Review E · doi:10.1103/physreve.74.031916 · Cited by 114
Computer Intensive Testing for the Influence Between Time Series
Baccalá, L. A., Takahashi, D. Y., & Sameshima, K. (2006) · Wiley eBooks · doi:10.1002/9783527609970.ch16 · Cited by 37
Cited by
A Tutorial Review of Functional Connectivity Analysis Methods and Their Interpretational Pitfalls
Bastos, A. M., & Schoffelen, J.-M. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00175 · Cited by 1,313
Farahani, F. V., Karwowski, W., & Lighthall, N. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00585 · Cited by 718
Defining epileptogenic networks: Contribution of SEEG and signal analysis
Bartolomei, F., Lagarde, S., Wendling, F., McGonigal, A., Jirsa, V., Guye, M., & Bénar, C. (2017) · Epilepsia · doi:10.1111/epi.13791 · Cited by 637
Self-citationHow reliable are MEG resting-state connectivity metrics?
Colclough, G. L., Woolrich, M. W., Tewarie, P. K., Brookes, M. J., Quinn, A. J., & Smith, S. M. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.05.070 · Cited by 414
Du, Y., Fu, Z., & Calhoun, V. D. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00525 · Cited by 332
Metadata
- Authors
- Wang, H. E., Bénar, C. G., Quilichini, P. P., Friston, K. J., Jirsa, V. K., & Bernard, C.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2014-12-09
- Volume
- 8
- Pages
- 405-405
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2079634169
- Cited by
- 327
- References
- 39
- FWCI
- 7.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.