Predictive modelling using neuroimaging data in the presence of confounds
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
When training predictive models from neuroimaging data, we typically have available non-imaging variables such as age and gender that affect the imaging data but which we may be uninterested in from a clinical perspective. Such variables are commonly referred to as 'confounds'. In this work, we firstly give a working definition for confound in the context of training predictive models from samples of neuroimaging data. We define a confound as a variable which affects the imaging data and has an association with the target variable in the sample that differs from that in the population-of-interest, i.e., the population over which we intend to apply the estimated predictive model. The focus of this paper is the scenario in which the confound and target variable are independent in the population-of-interest, but the training sample is biased due to a sample association between the target and confound. We then discuss standard approaches for dealing with confounds in predictive modelling such as image adjustment and including the confound as a predictor, before deriving and motivating an Instance Weighting scheme that attempts to account for confounds by focusing model training so that it is optimal for the population-of-interest. We evaluate the standard approaches and Instance Weighting in two regression problems with neuroimaging data in which we train models in the presence of confounding, and predict samples that are representative of the population-of-interest. For comparison, these models are also evaluated when there is no confounding present. In the first experiment we predict the MMSE score using structural MRI from the ADNI database with gender as the confound, while in the second we predict age using structural MRI from the IXI database with acquisition site as the confound. Considered over both datasets we find that none of the methods for dealing with confounding gives more accurate predictions than a baseline model which ignores confounding, although including the confound as a predictor gives models that are less accurate than the baseline model. We do find, however, that different methods appear to focus their predictions on specific subsets of the population-of-interest, and that predictive accuracy is greater when there is no confounding present. We conclude with a discussion comparing the advantages and disadvantages of each approach, and the implications of our evaluation for building predictive models that can be used in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796 · cited 1×
“…worth noting that various approaches to modifying or constraining the estimated weights have been proposed in the context of estimating causal e ff ects (Cole and Hernán, 2008; Imai and Ratkovic, 2014), and it may be interesting to also explore their application to neuroimaging data in further work.”
BackgroundImproving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
The Propensity Score with Continuous Treatments
Hirano, K., & Imbens, G. W. (2004) · Wiley Series in Probability and Statistics · doi:10.1002/0470090456.ch7 · Cited by 1,064
Permutation, Parametric and Bootstrap Tests of Hypotheses
(2005) · Springer Series in Statistics · doi:10.1007/b138696 · Cited by 707
Young, J., Modat, M., Cardoso, M. J., Mendelson, A., Cash, D., & Ourselin, S. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.05.004 · Cited by 249
Brown, M. R. G., Sidhu, G. S., Greiner, R., Asgarian, N., Bastani, M., Silverstone, P. H., Greenshaw, A. J., & Dursun, S. M. (2012) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2012.00069 · Cited by 185 · cited 1×
“There remains however, some uncertainty as to how to incorporate variables such as age and gender in predictive modelling (Brown et al., 2012).”
Background
Cited by
Harmonization of cortical thickness measurements across scanners and sites
Fortin, J.-P., Cullen, N., Sheline, Y. I., Taylor, W. D., Aselcioglu, I., Cook, P. A., Adams, P., Cooper, C., Fava, M., McGrath, P. J., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.024 · Cited by 1,580
“This shows that failing to account for age when removing site effects in an unbalanced sample leads to removal of age-related signal, as described in Rao et al., (2017).”
BackgroundTen simple rules for predictive modeling of individual differences in neuroimaging
Scheinost, D., Noble, S., Horien, C., Greene, A. S., Lake, E. M., Salehi, M., Gao, S., Shen, X., O'Connor, D., Barron, D. S., et al. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.02.057 · Cited by 381
Confound modelling in UK Biobank brain imaging
Alfaro-Almagro, F., McCarthy, P., Afyouni, S., Andersson, J. L. R., Bastiani, M., Miller, K. L., Nichols, T. E., & Smith, S. M. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117002 · Cited by 249
“, 2014), (Rao et al., 2017)) either regress out the confounds from the data, or use them as additional regressors in their (e.”
Brain–phenotype models fail for individuals who defy sample stereotypes
Greene, A. S., Shen, X., Noble, S., Horien, C., Hahn, C. A., Arora, J., Tokoglu, F., Spann, M. N., Carrión, C. I., Barron, D. S., et al. (2022) · Nature · doi:10.1038/s41586-022-05118-w · Cited by 167
How to control for confounds in decoding analyses of neuroimaging data
Snoek, L., Miletić, S., & Scholte, H. S. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.074 · Cited by 143
Metadata
- Authors
- Rao, A., Monteiro, J. M., & Mourao-Miranda, J.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2017-04
- Volume
- 150
- Pages
- 23-49
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2580744997
- Cited by
- 114
- References
- 7
- FWCI
- 5.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predictive modelling using neuroimaging data in the presence of confounds. https://app.cochat.ai/papers/10.1016/j.neuroimage.2017.01.066
- The paper
- Rao, A., Monteiro, J. M., & Mourao-Miranda, J. (2017). Predictive modelling using neuroimaging data in the presence of confounds. NeuroImage. https://doi.org/10.1016/j.neuroimage.2017.01.066
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.