A Review of Challenges in the Use of fMRI for Disease Classification / Characterization and A Projection Pursuit Application from A Multi-site fMRI Schizophrenia Study
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Functional magnetic resonance imaging (fMRI) is a fairly new technique that has the potential to characterize and classify brain disorders such as schizophrenia. It has the possibility of playing a crucial role in designing objective prognostic/diagnostic tools, but also presents numerous challenges to analysis and interpretation. Classification provides results for individual subjects, rather than results related to group differences. This is a more complicated endeavor that must be approached more carefully and efficient methods should be developed to draw generalized and valid conclusions out of high dimensional data with a limited number of subjects, especially for heterogeneous disorders whose pathophysiology is unknown. Numerous research efforts have been reported in the field using fMRI activation of schizophrenia patients and healthy controls. However, the results are usually not generalizable to larger data sets and require careful definition of the techniques used both in designing algorithms and reporting prediction accuracies. In this review paper, we survey a number of previous reports and also identify possible biases (cross-validation, class size, e.g.) in class comparison/prediction problems. Some suggestions to improve the effectiveness of the presentation of the prediction accuracy results are provided. We also present our own results using a projection pursuit algorithm followed by an application of independent component analysis proposed in an earlier study. We classify schizophrenia versus healthy controls using fMRI data of 155 subjects from two sites obtained during three different tasks. The results are compared in order to investigate the effectiveness of each task and differences between patients with schizophrenia and healthy controls are investigated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brain magnetic resonance imaging with contrast dependent on blood oxygenation.
Ogawa, S., Lee, T. M., Kay, A. R., & Tank, D. W. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.24.9868 · Cited by 6,483
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation.
Kwong, K. K., Belliveau, J. W., Chesler, D. A., Goldberg, I. E., Weisskoff, R. M., Poncelet, B. P., Kennedy, D. N., Hoppel, B. E., Cohen, M. S., & Turner, R. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.12.5675 · Cited by 4,212 · cited 1×
“Functional magnetic resonance imaging (fMRI) is a fairly new and unique tool that enables widespread, noninvasive investigation of brain functions (Kwong et al. 1992).”
BackgroundA method for making group inferences from functional MRI data using independent component analysis
Calhoun, V. D., Adali, T., Pearlson, G. D., & Pekar, J. J. (2001) · Human Brain Mapping · doi:10.1002/hbm.1048 · Cited by 2,994 · cited 2×
“During our research study, we applied three group ICA operations (Calhoun et al. 2001a, b; GIFT 2008) on the data from three different tasks and obtained 20 independent spatial components and a set of time courses for each task.”
BackgroundMethodSelf-citationAdaptive Control Processes: A Guided Tour
Bellman, R. E. (1961) · doi:10.1515/9781400874668 · Cited by 2,802
Inhibition in schizophrenia: association with auditory hallucinations
Waters, F. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(02)00358-4 · Cited by 139
Research works printed but not linked: 43
- Braff, D. L. (1993). Information processing and attention dysfunctions in schizophrenia. Schizophrenia Bulletin, 19, 233–259. · DOI · Paper page
- Calhoun, V. D., Adali, T., Pearlson, G. D., & Pekar, J. J. (2001c). Spatial and temporal independent component analysis of functional MRI data containing a pair of task-related waveforms. Human Brain Mapping, 13, 43–53. · DOI · Paper page
- Calhoun, V. D., Kiehl, K. A., Liddle, P. F., & Pearlson, G. D. (2004). Aberrant localization of synchronous hemodynamic activity in auditory cortex reliably characterizes schizophrenia. Biological Psychiatry, 55, 842–849. · DOI
- Calhoun, V. D., Maciejewski, P. K., Pearlson, G. D., Pearlson, G. D., & Kiehl, K. A. (2008). Temporal lobe and default hemodynamic brain modes discriminate between schizophrenia and bipolar disorder. Human Brain Mapping (in press). · DOI · Paper page
- Casey, B., Cohen, J., & O’Craven, K. (1998). Reproducability of fMRI results across four institutions using a spatial working memory task. NeuroImage, 8(3), 249–261. · DOI · Paper page
- Demirci, O., & Calhoun, V. D. (2007). Detection of schizophrenia using fMRI data via projection pursuit. In IEEE international workshop on machine learning for signal processing. Thessaloniki, Greece. · DOI
- Demirci, O., Clark, V., & Calhoun, V. D. (2008). A projection pursuit algorithm to classify individuals using fMRI data: Application to schizophrenia. NeuroImage, 39, 1774–1782. · DOI
- Demirci, O., Tyo, J. S., & Ritchie, E. A. (2007). Spatial and spatiotemporal projection pursuit techniques to predict the extratropical transition of tropical cyclones. IEEE Transactions on Geoscience and Remote Sensing, 45, 418–425. · DOI
- Fan, Y., Rao, H., Hurt, H., Gianetta, J., Korczykowski, M., Shera, D., et al. (2007). Multivariate examination of brain abnormality using both structural and functional MRI. NeuroImage, 36, 1189–1199. · DOI
- First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1995). Structured clinical interview for Dsm-Iv axis I disorders—patient edition (Scid-I/P, Version 2.0). New York: Biometrics Research Department, New York State Psychiatric Institute.
- Ford, J., Farid, H., Makedon, F., Flashman, L., McAllister, T., Megalooikonomou, V., et al. (2003). Patient classification of fMRI activation maps. In Proc. of the 6th annual international conference on medical image computing and computer assisted intervention (MICCAI’03). · DOI
- Ford, J., Shen, L., Makedon, F., Flashman, L. A., & Saykin, A. J. (2002). A combined structural-functional classification of schizophrenia using hippocampal volume plus fMRI activation. In Second joint EMBS/BMES conference. Houston, TX. · DOI
- Freire, L., Roche, A., & Mangin, J. F. (2002). What is the best similarity measure for motion correction in fMRI time series? IEEE Transactions on Medical Imaging, 21, 470–484. · DOI · Paper page
- Friedman, L., Glover, G. H., & FBIRN (2006). Reducing interscanner variability of activation in a multicenter fMRI study: Controlling for signal-to-fluctuation-noise-ratio (sfnr) differences. NeuroImage, 33, 471–481. · DOI · Paper page
- Friston, K., Ashburner, J., Frith, C. D., Poline, J. P., Heather, J. D., & Frackowiak, R. S. (1995). Spatial registration and normalization of images. Human Brain Mapping, 2, 165–189. · DOI · Paper page
- Garrity, A. G., Pearlson, G. D., McKiernan, K., Lloyd, D., Kiehl, K. A., & Calhoun, V. D. (2007). Aberrant “default mode” functional connectivity in schizophrenia. American Journal of Psychiatry, 164(3), 450–457. · DOI · Paper page
- Georgopoulos, A. P., Karageorgiou, E., Leuthold, A., Lewis, S. M., Lynch, J., Alonso, A. A., et al. (2007). Synchronous neural interactions assessed by magnetoencephalography: A functional biomarker for brain disorders. Journal of Neural Engineering, 4, 349–355. · DOI
- Gerig, G., Styner, M., Shenton, M. E., & Lieberman, J. A. (2001). Shape versus size: Improved understanding of the morphology of brain structures. In Proc. MICCAI 2001. Lecture Notes in Computer Science 2208 (pp. 24–32). · DOI
- Golland, P., Grimson, W. E. L., Shenton, M. E., & Kikinis, R. (2000). Small sample size learning for shape analysis of anatomical structures. In Proceedings of MICCAI. Third international conference on medical robotics, imaging and computer assisted intervention, LNCS (Vol. 1935, pp. 72–82). · doi:10.1007/978-3-540-40899-4_8
- Hyvarinen, A., Karhunen, Y., & Oja, E. (2001). Independent component analysis. New York: Wiley-Interscience (May 18) · DOI · Paper page
- Jimenez, L. O., & Landgrebe, D. A. (1998). Supervised classification in high-dimensional space: Geometrical, statistical, and asymptotical properties of multivariate data. IEEE Transactions on Systems, Man, and Cybernetics-Part C, 28, 39–54. · DOI · Paper page
- Jimenez, L. O., & Landgrebe, D. A. (1999). Hyperspectral data analysis and supervised feature reduction via projection pursuit. IEEE Transactions on Geoscience and Remote Sensing, 37, 2653–2667. · DOI · Paper page
- Job, D. E., Whalley, H. C., McIntosh, A. M., Owens, D. G., Johnstone, E. C., & Lawrie, S. M. (2006). Grey matter changes can improve the prediction of schizophrenia in subjects at high risk. BioMed Central, 4, 29.
- Kiehl, K. A., Liddle, P. F. (2001). An event-related functional magnetic resonance imaging study of an auditory oddball task in schizophrenia. Schizophrenia Research, 48, 159–171. · DOI · Paper page
- Kiehl, K. A., Stevens, M. C., Celone, K., Kurtz, M., & Krystal, J. H. (2005). Abnormal hemodynamics in schizophrenia during an auditory oddball task. Biological Psychiatry, 57, 1029–1040. · DOI
- Kontos, D., Megalooikonomou, V., Ghubade, N., & Faloutsos, C. (2004). Detecting discriminative functional MRI activation patterns using space filling curves. In Proc. of the 25th annual international conference of the IEEE engineering in medicine and bilogy society (EMBC). Cancun, Mexico.
- McCarley, R. W., Shenton, M. E., O’Donnell, B. F., Faux, S. F., Kikinis, R., Nestor, P. G., et al. (1993). Auditory p300 abnormalities and left posterior superior temporal gyrus volume reduction in schizophrenia. Archives of General Psychiatry, 50, 190–197. · DOI · Paper page
- McGhie, A., & Chapman, J. (1961). Disorders of attention and perception in early schizophrenia. British Journal of Medical Psychology, 34, 103–116. · DOI · Paper page
- McKeown, M. J., Makeig, S., Brown, G. G., Jung, T. P., Kindermann, S. S., Bell, A. J., et al. (1998). Analysis of fmri data by blind separation into independent spatial components. Human Brain Mapping, 6, 160–188. · doi:10.1002/(sici)1097-0193(1998)6:3<160::aid-hbm5>3.0.co;2-1
- Nakamura, K., Kawasaki, Y., Suzuki, M., Hagino, H., Kurokawa, K., Takahashi, T., et al. (2004). Multiple structural brain measures obtained by three-dimensional magnetic resonance imaging to distinguish between schizophrenia patients and normal subjects. American Journal of Psychiatry, 158, 1809–1817.
- Pardo, P. J., Georgopoulos, A. P., Kenny, J. T., Stuve, T. A., Findling, R. L., & Schulz, S. C. (2006). Classification of adolescent psychotic disorders using linear discriminant analysis. Schizophrenia Research, 87, 297–306. · DOI
- Pokrajac, D., Megalooikonomou, V., Lazarevic, A., Kontos, D., & Obradovic, Z. (2005). Applying spatial distribution analysis techniques to classification of 3D medical images. Artificial Intelligence in Medicine, 33, 261–280. · DOI
- Robert, P., & Escoufier, Y. (1976). A unifying tool for linear multivariate statistical methods: The RV-coefficient. Applied Statistics, 25, 257–265. · DOI · Paper page
- Shankardass, A., Nicolson, R., & Fawcett, A. (2001). A combined structural–functional classification of schizophrenia using hippocampal volume plus fMRI activation. In 5th BDA international conference. University of York, UK.
- Shen, L., Ford, J., Makedon, F., & Saykin, A. (2004). A surface-based approach for classification of 3d neuroanatomic structures. Intelligent Data Analysis, An International Journal, 8(6), 519–542. · DOI
- Shinkareva, S. V., Ombao, H. C., Sutton, B. P., Mohanty, A., & Miller, G. A. (2006). Classification of functional brain images with a spatio-temporal dissimilarity map. NeuroImage, 33, 63–71. · DOI
- Simon, R. (2004). When is a genomic classifier ready for prime time? Nature Clinical Practice, 1, 4–5. · DOI
- Simon, R., Radmacher, M. D., Dobbin, K., & McShane, L. M. (2003). Pitfalls in the use of DNA Microarray Data for Diagnostic and Prognostic Classification. Journal of the National Cancer Institute, 95(1), 14–18. · DOI · Paper page
- Symond, M. B., Harris, A. W. F., Gordon, E., & Williams, L. M. (2005). Gamma synchrony in first-episode schizophrenia: A disorder of temporal connectivity? American Journal of Psychiatry, 162, 459–465. · DOI · Paper page
- Tecchio, F., Benassic, F., Zappasodia, F., Gialloretid, L. E., Palermoe, M., Serif, S., et al. (2003). Auditory sensory processing in autism: A magnetoencephalographic study. Biological Psychiatry, 54, 647–654. · DOI
- Tegeler, C., Strother, S., Anderson, J., & Kim, S. (1999). Reproducability of BOLD-based functional MRI obtained at 4T. Human Brain Mapping, 7(4), 267–283. · DOI · Paper page
- Wang, Q., Kontos, D., Li, G., & Megalooikonomou, V. (2004). Application of time series techniques to data mining and analysis of spatial patterns in 3D images. In Proc. of the 2004 IEEE international conference on acoustics, speech, and signal processing (ICASSP 2004). · doi:10.1109/icassp.2004.1326597
- Wood, I., Visscher, P., & Mengersen, K. (2007). Classification based upon gene expression data: Bias and precision of error rates. Bioinformatics, 23, 1363–1370. · DOI · Paper page
Cited by
Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Self-citationAssessing and tuning brain decoders: Cross-validation, caveats, and guidelines
Varoquaux, G., Raamana, P. R., Engemann, D. A., Hoyos-Idrobo, A., Schwartz, Y., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.038 · Cited by 792
Machine learning in major depression: from classification to treatment outcome prediction
Gao, S., Calhoun, V. D., & Sui, J. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.13048 · Cited by 370
Self-citationSui, J., He, H., Pearlson, G. D., Adali, T., Kiehl, K. A., Yu, Q., Clark, V. P., Castro, E., White, T., Mueller, B. A., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.10.051 · Cited by 143
Self-citationDemirci, O., Stevens, M. C., Andreasen, N. C., Michael, A., Liu, J., White, T., Pearlson, G. D., Clark, V. P., & Calhoun, V. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.02.014 · Cited by 126
“We employed a group spatial ICA operation (Calhoun et al., 2001a,b; GIFT, 2008) on the data obtained from all subjects to separate the data into maximally independent sets and identify the networks most related to schizophrenia (Demirci et al., 2007, 2008a,b; Demirci and Calhoun, 2007).”
MethodSelf-citation
Metadata
- Authors
- Demirci, O., Clark, V. P., Magnotta, V. A., Andreasen, N. C., Lauriello, J., Kiehl, K. A., Pearlson, G. D., & Calhoun, V. D.
- Venue
- Brain Imaging and Behavior
- Published
- 2008-08-09
- Volume
- 2
- Issue
- 3
- Pages
- 207-226
- ISSN
- 1931-7557 (ISSN-L)
- 1931-7565
- OpenAlex
- W2146594014
- Cited by
- 107
- References
- 6
- FWCI
- 3.57
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Review of Challenges in the Use of fMRI for Disease Classification / Characterization and A Projection Pursuit Application from A Multi-site fMRI Schizophrenia Study. https://app.cochat.ai/papers/10.1007/s11682-008-9028-1
- The paper
- Demirci, O., Clark, V. P., Magnotta, V. A., Andreasen, N. C., Lauriello, J., Kiehl, K. A., Pearlson, G. D., & Calhoun, V. D. (2008). A Review of Challenges in the Use of fMRI for Disease Classification / Characterization and A Projection Pursuit Application from A Multi-site fMRI Schizophrenia Study. Brain Imaging and Behavior. https://doi.org/10.1007/s11682-008-9028-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.