Interrater and intermethod reliability of default mode network selection
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
There has been a growing interest in the neuroimaging community regarding resting state data (i.e., passive mental activity) and the subsequent activation of the so‐called default mode network (DMN). Although this network was originally characterized by a pattern of deactivation during active cognitive states, more recent applications of data‐driven techniques such as independent component analysis (ICA) have permitted the analysis of brain activation during extended periods of truly passive mental activity. However, ICA requires the resultant components to be evaluated for “goodness of fit” via either human raters or more automated techniques. To our knowledge, an investigation on the reliability of either technique in determining the component that best corresponds to default‐mode activity has not been performed. Moreover, it is not clear how automated techniques, which are necessarily dependent upon a template mask, are affected by the structures used to compose the mask. The current study investigated both interrater (human‐human) reliability and intermethod (human‐machine) reliability for determining DMN activation in 42 healthy controls. Results indicated that near perfect interrater reliability was achieved, whereas intermethod reliability was only within the moderate range. The latter was significantly improved via a weighted combination of the anterior and posterior cingulate nodes of the DMN. Implications for fully automating the component selection process are discussed. Hum Brain Mapp, 2009. © 2009 Wiley‐Liss, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
The Brain's Default Network: Anatomy, Function, and Relevance to Disease
Buckner, R. L., Andrews‐Hanna, J. R., & Schacter, D. L. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.011 · Cited by 9,761
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging
Fox, M. D., & Raichle, M. E. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2201 · Cited by 6,700
Functional connectivity in the resting brain: a network analysis of the default mode hypothesis
Greicius, M. D., Krasnow, B., Reiss, A. L., & Menon, V. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0135058100 · Cited by 6,358 · cited 9×
“Previous researchers have utilized the anterior and posterior cingulate as seed voxels to detect the remainder of the DMN [Fox et al., 2005; Fransson, 2005; Greicius et al., 2003; Shulman et al., 1997] and resting-state metabolism has shown to be the highest in the posterior cingulate gyrus [Gusnard and Raichle, 2001].”
BackgroundMethodInfluentialConsistent resting-state networks across healthy subjects
Damoiseaux, J. S., Rombouts, S. A. R. B., Barkhof, F., Scheltens, P., Stam, C. J., Smith, S. M., & Beckmann, C. F. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601417103 · Cited by 4,326 · cited 12×
“…template (i.e., mask), which can subsequently be used to automate and standardize the component selection process across different institutions [Damoiseaux et al., 2006; Fox et al., 2005; Fransson, 2005; Greicius et al., 2003; Mazoyer et al., 2001; Raichle et al., 2001; Shulman et al., 1997].”
BackgroundMethodResultInfluentialGreicius, M. D., Srivastava, G., Reiss, A. L., & Menon, V. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308627101 · Cited by 3,684 · cited 16×
“…use of a stereotaxic (generated through anatomical labels) or empirically (generated from DMN data) derived template as a spatial mask if semiautomatic or fully automatic techniques are to be adopted [Calhoun et al., 2007; Greicius and Menon, 2004; Greicius et al., 2004; Van de Ven et al., 2004].”
BackgroundMethodInfluentialInvestigations into resting-state connectivity using independent component analysis
Beckmann, C. F., DeLuca, M., Devlin, J. T., & Smith, S. M. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1634 · Cited by 3,398
Searching for a baseline: Functional imaging and the resting human brain
Gusnard, D. A., & Raichle, M. E. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094500 · Cited by 3,371
A method for making group inferences from functional MRI data using independent component analysis
Calhoun, V. D., Adali, T., Pearlson, G. D., & Pekar, J. J. (2001) · Human Brain Mapping · doi:10.1002/hbm.1048 · Cited by 2,994 · cited 12×
“The resulting components from individual and multirun ICAs were then converted to a 1 mm3 standard stereotaxic coordinate space [Talairach and Tournoux, 1988].”
MethodInfluentialSelf-citationWandering minds: the default network and stimulus-independent thought
Mason, M. F., Norton, M. I., Van Horn, J. D., Wegner, D. M., Grafton, S. T., & Macrae, C. N. (2007) · Science · doi:10.1126/science.1131295 · Cited by 2,792 · cited 3×
“…2008; Damoiseaux et al., 2006; Fox and Raichle, 2007; Gilbert et al., 2007; Greicius et al., 2003; Gusnard and Raichle, 2001; Jafri et al., 2007; Mason et al., 2007; Morcom and Fletcher, 2007; Raichle and Snyder, 2007; Raichle et al., Contract grant sponsor: The Mind Research Network—Mental…”
BackgroundCommon blood flow changes across visual tasks: II. Decreases in cerebral cortex
Shulman, G. L., Fiez, J. A., Corbetta, M., Buckner, R. L., Miezin, F. M., Raichle, M. E., & Petersen, S. E. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.648 · Cited by 1,890 · cited 9×
“Previous researchers have utilized the anterior and posterior cingulate as seed voxels to detect the remainder of the DMN [Fox et al., 2005; Fransson, 2005; Greicius et al., 2003; Shulman et al., 1997] and resting-state metabolism has shown to be the highest in the posterior cingulate gyrus [Gusnard and Raichle, 2001].”
BackgroundMethodInfluentialA Parametric Manipulation of Factors Affecting Task-induced Deactivation in Functional Neuroimaging
McKiernan, K. A., Kaufman, J. N., Kucera-Thompson, J., & Binder, J. R. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321593117 · Cited by 1,080 · cited 2×
“However, the magnitude of task-induced deactivation has been linked to the cognitive demands of tasks [Esposito et al., 2006; McKiernan et al., 2003], suggesting that task-induced deactivations may not be an ideal methodology for probing true passive mental activity.”
BackgroundConceptual Processing during the Conscious Resting State: A Functional MRI Study
Binder, J. R., Frost, J. A., Hammeke, T. A., Bellgowan, P. S. F., Rao, S. M., & Cox, R. W. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563265 · Cited by 1,066 · cited 4×
“, 2008], becomes deactivated during more demanding cognitive tasks [Binder et al., 1999; Gusnard and Raichle, 2001; Shulman et al., 1997], and which may serve as an intrinsic baseline state [Raichle and Gusnard, 2005].”
BackgroundMethodInfluentialMazoyer, B., Zago, L., Mellet, E., Bricogne, S., Etard, O., Houdé, O., Crivello, F., Joliot, M., Petit, L., & Tzourio-Mazoyer, N. (2001) · Brain Research Bulletin · doi:10.1016/s0361-9230(00)00437-8 · Cited by 906
Greicius, M. D., & Menon, V. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042568532 · Cited by 684 · cited 9×
“…use of a stereotaxic (generated through anatomical labels) or empirically (generated from DMN data) derived template as a spatial mask if semiautomatic or fully automatic techniques are to be adopted [Calhoun et al., 2007; Greicius and Menon, 2004; Greicius et al., 2004; Van de Ven et al., 2004].”
BackgroundMethodInfluential
Cited by
A Baseline for the Multivariate Comparison of Resting-State Networks
Allen, E. A., Erhardt, E. B., Damaraju, E., Gruner, W., Segall, J. M., Silva, R. F., Havlicek, M., Rachakonda, S., Fries, J., Kalyanam, R., et al. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00002 · Cited by 1,293
Self-citationZuo, X.-N., Kelly, C., Adelstein, J. S., Klein, D. F., Castellanos, F. X., & Milham, M. P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.080 · Cited by 744
Abnormal functional connectivity of default mode sub-networks in autism spectrum disorder patients
Assaf, M., Jagannathan, K., Calhoun, V. D., Miller, L., Stevens, M. C., Sahl, R., O'Boyle, J. G., Schultz, R. T., & Pearlson, G. D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.067 · Cited by 680
Self-citationZhu, X., Wang, X., Xiao, J., Liao, J., Zhong, M., Wang, W., & Yao, S. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.10.035 · Cited by 638
Graph-based network analysis of resting-state functional MRI
Wang, J. (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00016 · Cited by 614
Metadata
- Authors
- Franco, A. R., Pritchard, A., Calhoun, V. D., & Mayer, A. R.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2009-02-10
- Volume
- 30
- Issue
- 7
- Pages
- 2293-2303
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2022411182
- Cited by
- 126
- References
- 16
- FWCI
- 3.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.