The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Visual inspection of independent components: Defining a procedure for artifact removal from fMRI data
Open accessAbstract
Artifacts in functional magnetic resonance imaging (fMRI) data, primarily those related to motion and physiological sources, negatively impact the functional signal-to-noise ratio in fMRI studies, even after conventional fMRI preprocessing. Independent component analysis' demonstrated capacity to separate sources of neural signal, structured noise, and random noise into separate components might be utilized in improved procedures to remove artifacts from fMRI data. Such procedures require a method for labeling independent components (ICs) as representing artifacts to be removed or neural signals of interest to be spared. Visual inspection is often considered an accurate method for such labeling as well as a standard to which automated labeling methods are compared. However, detailed descriptions of methods for visual inspection of ICs are lacking in the literature. Here we describe the details of, and the rationale for, an operationalized fMRI data denoising procedure that involves visual inspection of ICs (96% inter-rater agreement). We estimate that dozens of subjects/sessions can be processed within a few hours using the described method of visual inspection. Our hope is that continued scientific discussion of and testing of visual inspection methods will lead to the development of improved, cost-effective fMRI denoising procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Two raters blind to induction visually inspected the spatial patterns and timecourses of the 26 extracted components independently (see Kelly et al. 2010) and determined that 24 of the 26 components were nonartifactual (inter-rater agreement was 100% on which components were nonartifact and artifact).”
From Neural Mechanisms of Episodic Retrieval Support Divergent Creative Thinking (2019) · cites this paper as Kelly et al. 2010
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., & Raichle, M. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504136102 · Cited by 8,553
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738
Zhang, Y., Brady, M., & Smith, S. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 7,628
Fast and robust fixed-point algorithms for independent component analysis
Hyvärinen, A. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.761722 · Cited by 6,304
(2005) · Cited by 5,977
Movement‐Related effects in fMRI time‐series
Friston, K. J., Williams, S., Howard, R., Frackowiak, R. S. J., & Turner, R. (1996) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910350312 · Cited by 3,774
Greicius, M. D., Srivastava, G., Reiss, A. L., & Menon, V. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308627101 · Cited by 3,684
Investigations into resting-state connectivity using independent component analysis
Beckmann, C. F., DeLuca, M., Devlin, J. T., & Smith, S. M. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1634 · Cited by 3,398
A method for making group inferences from functional MRI data using independent component analysis
Calhoun, V. D., Adali, T., Pearlson, G. D., & Pekar, J. J. (2001) · Human Brain Mapping · doi:10.1002/hbm.1048 · Cited by 2,994
Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0931 · Cited by 2,859
Probabilistic Independent Component Analysis for Functional Magnetic Resonance Imaging
Beckmann, C. F., & Smith, S. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.822821 · Cited by 2,707
Bayesian analysis of neuroimaging data in FSL
Woolrich, M. W., Jbabdi, S., Patenaude, B., Chappell, M., Makni, S., Behrens, T., Beckmann, C., Jenkinson, M., & Smith, S. M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.055 · Cited by 2,385
Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration
Klein, A., Andersson, J., Ardekani, B. A., Ashburner, J., Avants, B., Chiang, M.-C., Christensen, G. E., Collins, D. L., Gee, J., Hellier, P., et al. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.037 · Cited by 2,227
Greicius, M. D., Flores, B. H., Menon, V., Glover, G. H., Solvason, H. B., Kenna, H., Reiss, A. L., & Schatzberg, A. F. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.09.020 · Cited by 2,214
A default mode of brain function: a brief history of an evolving idea
Raichle, M. E., & Snyder, A. Z. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.041 · Cited by 2,173
Prefrontal-Subcortical Pathways Mediating Successful Emotion Regulation
Wager, T. D., Davidson, M. L., Hughes, B. L., Lindquist, M. A., & Ochsner, K. N. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.006 · Cited by 1,761 · cited 1×
“…costs and the availability of automated methods for drawing ROIs, some studies still utilize manual drawing of ROIs (McKeown and Hanlon, 2004; Pereira et al., 2007; Wager et al., 2008), presumably because of anticipated improvement in drawing accuracy with manual methods (Huettel et al., 2004c).”
MethodFrequencies contributing to functional connectivity in the cerebral cortex in "resting-state" data.
Cordes, D., Haughton, V. M., Arfanakis, K., Carew, J. D., Turski, P. A., Moritz, C. H., Quigley, M., & Meyerand, M. E. (2001) · PubMed Central · Cited by 1,402
Birn, R. M., Diamond, J. B., Smith, M. A., & Bandettini, P. A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.02.048 · Cited by 1,381
An in vivo correlate of exercise-induced neurogenesis in the adult dentate gyrus
Pereira, A. C., Huddleston, D. E., Brickman, A. M., Sosunov, A. A., Hen, R., McKhann, G. M., Sloan, R., Gage, F. H., Brown, T. R., & Small, S. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611721104 · Cited by 1,353
Functional Magnetic Resonance Imaging
Walsh, A. (2014) · Encyclopedia of Criminal Justice Ethics · doi:10.4135/9781452274102.n135 · Cited by 1,225
Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions
O’Craven, K. M., & Kanwisher, N. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137549 · Cited by 1,078
Modeling Geometric Deformations in EPI Time Series
Andersson, J., Hutton, C., Ashburner, J., Turner, R., & Friston, K. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0746 · Cited by 1,004
Functional MRI : an introduction to methods
Jezzard, P., Matthews, P. M., & Smith, S. M. (2002) · Cited by 883
Statistical analysis of activation images
Worsley, K. J. (2001) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780192630711.003.0014 · Cited by 864
Group comparison of resting-state FMRI data using multi-subject ICA and dual regression
Beckmann, C. F., Mackay, C., Filippini, N., & Smith, S. R. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)71511-3 · Cited by 744
Domain Specificity in Visual Cortex
Downing, P. E., Chan, A. W.-Y., Peelen, M. V., Dodds, C. M., & Kanwisher, N. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj086 · Cited by 510
Automatic Choice of Dimensionality for PCA
Minka, T. P. (2000) · Cited by 499
Retrospective estimation and correction of physiological fluctuation in functional MRI
Hu, X. P., Le, T. H., Parrish, T. B., & Erhard, P. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910340211 · Cited by 474
Localization of Cardiac-Induced Signal Change in fMRI
Dagli, M. S., Ingeholm, J. E., & Haxby, J. V. (1999) · NeuroImage · doi:10.1006/nimg.1998.0424 · Cited by 385
Calhoun, V. D., Adalı, T., McGinty, V. B., Pekar, J. J., Watson, T. D., & Pearlson, G. D. (2001) · NeuroImage · doi:10.1006/nimg.2001.0921 · Cited by 306
Reduction of physiological fluctuations in fMRI using digital filters
Biswal, B. B., DeYoe, E. A., & Hyde, J. S. (1996) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910350114 · Cited by 305
Birn, R. M., Murphy, K., & Bandettini, P. A. (2008) · Human Brain Mapping · doi:10.1002/hbm.20577 · Cited by 283
Noise Reduction in BOLD-Based fMRI Using Component Analysis
Thomas, C. G., Harshman, R. A., & Menon, R. S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1200 · Cited by 280
Detection Power, Estimation Efficiency, and Predictability in Event-Related fMRI
Liu, T. T., Frank, L. R., Wong, E. C., & Buxton, R. B. (2001) · NeuroImage · doi:10.1006/nimg.2000.0728 · Cited by 261
Automatic independent component labeling for artifact removal in fMRI
Tohka, J., Foerde, K., Aron, A. R., Tom, S. M., Toga, A. W., & Poldrack, R. A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.013 · Cited by 217
Static and dynamic characteristics of cerebral blood flow during the resting state
Zou, Q., Wu, C. W., Stein, E. A., Zang, Y., & Yang, Y. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.006 · Cited by 209
CORSICA: correction of structured noise in fMRI by automatic identification of ICA components
Perlbarg, V., Bellec, P., Anton, J., Pélégrini‐Issac, M., Doyon, J., & Benali, H. (2006) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2006.09.042 · Cited by 201
Raj, D., Anderson, A. W., & Gore, J. C. (2001) · Physics in Medicine and Biology · doi:10.1088/0031-9155/46/12/318 · Cited by 199
Stone, J. V., Porrill, J., Porter, N. R., & Wilkinson, I. D. (2002) · NeuroImage · doi:10.1006/nimg.2001.0986 · Cited by 182
McKeown, M. J. (2000) · NeuroImage · doi:10.1006/nimg.1999.0518 · Cited by 175
Magnetic field changes in the human brain due to swallowing or speaking
Birn, R. M., Bandettini, P. A., Cox, R. W., Jesmanowicz, A., & Shaker, R. (1998) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910400108 · Cited by 172
On the origin of respiratory artifacts in BOLD-EPI of the human brain
Windischberger, C., Langenberger, H., Sycha, T., Tschernko, E., Fuchsjäger-Mayerl, G., Schmetterer, L. F., & Moser, E. (2002) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(02)00563-5 · Cited by 160
Experimental designs and processing strategies for fMRI studies involving overt verbal responses
Birn, R. M., Cox, R. W., & Bandettini, P. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.039 · Cited by 154
Functional neural circuits for mental timekeeping
Stevens, M. C. G., Kiehl, K. A., Pearlson, G. D., & Calhoun, V. D. (2006) · Human Brain Mapping · doi:10.1002/hbm.20285 · Cited by 146
Chen, S., Ross, T. J., Zhan, W., Myers, C. S., Chuang, K.-S., Heishman, S. J., Stein, E. A., & Yang, Y. (2008) · Brain Research · doi:10.1016/j.brainres.2008.08.028 · Cited by 139
Self-citationPetersson, K. M., Nichols, T. E., Poline, J., & Holmes, A. P. (1999) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1999.0477 · Cited by 129
Characterization and Correction of Interpolation Effects in the Realignment of fMRI Time Series
Grootoonk, S., Hutton, C., Ashburner, J., Howseman, A., Josephs, O., Rees, G. E., Friston, K. J., & Turner, R. (2000) · NeuroImage · doi:10.1006/nimg.1999.0515 · Cited by 127
Jing Sui （Beijing Normal University）， my correct affiliation is beijing normal university, N. Q. U. O. S. A. T., Adalı, T., Pearlson, G. D., & Calhoun, V. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.026 · Cited by 117
Functional MRI: An introduction to methods
Lewin, J. S. (2003) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.10284 · Cited by 87
Power spectrum ranked independent component analysis of a periodic fMRI complex motor paradigm
Moritz, C. H., Rogers, B. P., & Meyerand, M. E. (2002) · Human Brain Mapping · doi:10.1002/hbm.10081 · Cited by 64
Removing the effects of task-related motion using independent-component analysis
Kochiyama, T., Morita, T., Okada, T., Yonekura, Y., Matsumura, M., & Sadato, N. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.027 · Cited by 62
Wang, Z., & Peterson, B. S. (2007) · Human Brain Mapping · doi:10.1002/hbm.20434 · Cited by 44
Self-citationDetection of eye movements from fMRI data
Beauchamp, M. S. (2003) · Magnetic Resonance in Medicine · doi:10.1002/mrm.10345 · Cited by 43
Functional Magnetic Resonance Imaging
(2005) · Springer eBooks · doi:10.1007/3-540-29623-9_7101 · Cited by 43
Hybrid ICA‐Seed‐Based Methods for fMRI Functional Connectivity Assessment: A Feasibility Study
Kelly, R. E., Wang, Z., Alexopoulos, G. S., Gunning, F. M., Murphy, C. F., Morimoto, S. S., Kanellopoulos, D., Jia, Z., Lim, K. O., & Hoptman, M. J. (2010) · International Journal of Biomedical Imaging · doi:10.1155/2010/868976 · Cited by 27
Self-citationSuppression of physiological eye movement artifacts in functional MRI using slab presaturation
Chen, W., & Zhu, X. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910380407 · Cited by 24
ICA Denoising for Event-Related fMRI Studies
McKeown, M. J., Hu, Y.-J., & Wang, Z. J. (2005) · doi:10.1109/iembs.2005.1616366 · Cited by 15
Self-citationThe effect of artifacts on dependence measurement in fMRI
Gretton, A., Belitski, A., Murayama, Y., Schölkopf, B., & Logothetis, N. K. (2006) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2005.12.036 · Cited by 14
McKeown, M. J., & Hanlon, C. A. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.12.021 · Cited by 13
Glover (2000) · doi:10.1002/1522-2594(200007)44:1
Cited by
Sorted by citations
ICA-AROMA: A robust ICA-based strategy for removing motion artifacts from fMRI data
Pruim, R. H. R., Mennes, M., van Rooij, D., Llera, A., Buitelaar, J. K., & Beckmann, C. F. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.064 · Cited by 1,684
Zeng, L.-L., Shen, H., Liu, L., Wang, L., Li, B., Fang, P., Zhou, Z., Li, Y., & Hu, D. (2012) · Brain · doi:10.1093/brain/aws059 · Cited by 748
Building a Science of Individual Differences from fMRI
Dubois, J., & Adolphs, R. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.014 · Cited by 644
Hand classification of fMRI ICA noise components
Griffanti, L., Douaud, G., Bijsterbosch, J. D., Evangelisti, S., Alfaro‐Almagro, F., Glasser, M. F., Duff, E. P., Fitzgibbon, S. P., Westphal, R., Carone, D., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.036 · Cited by 577
Methods for cleaning the BOLD fMRI signal
Caballero-Gaudes, C., & Reynolds, R. C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.018 · Cited by 542
Metadata
- Authors
- Kelly, R. E., Alexopoulos, G. S., Wang, Z., Gunning, F. M., Murphy, C. F., Morimoto, S. S., Kanellopoulos, D., Jia, Z., Lim, K. O., & Hoptman, M. J.
- Affiliations
- Cornell University (US)
- New York State Psychiatric Institute (US)
- University of Minnesota (US)
- Nathan Kline Institute for Psychiatric Research (US)
- Corresponding author
- Kelly, Robert E.
- ORCID
- Venue
- Journal of Neuroscience Methods
- Publisher
- Elsevier BV
- Published
- 2010-06
- Volume
- 189
- Issue
- 2
- Pages
- 233-245
- ISSN
- 0165-0270 (ISSN-L)
- PMC
- PMC3299198
- OpenAlex
- W2067963436
- Cited by
- 345
- References
- 65
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 13 · 2023: 7 · 2022: 15 · 2021: 27 · 2020: 25 · 2019: 31 · 2018: 37 · 2017: 49 · 2016: 35 · 2015: 33 · 2014: 22 · 2013: 23 · 2012: 12
- FWCI
- 20.32
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Neuroscience Methods (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eli Lilly and Company
- National Institute of Mental Health (K23MH067702, P30MH085943, R01MH065653, T32MH019132, K23MH074818)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Blind Source Separation Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- independent component analysis, visual inspection, fMRI denoising, motion artifacts, physiological noise, interobserver agreement, connected component labeling, signal-to-noise ratio
- MeSH terms
- Brain, Brain Mapping, Computer Simulation, Data Interpretation, Statistical, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Mental Processes, Middle Aged, Neuropsychological Tests, Rest, Time Factors, Visual Perception, Observer Variation, Artifacts, Databases as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
