Bridging Functional MR Images and Scientific Inference: Reproducibility Maps
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Historically, reproducibility has been the sine qua non of experimental findings that are considered to be scientifically useful. Typically, findings from functional magnetic resonance imaging (fMRI) studies are assessed with statistical parametric maps (SPMs) using a p value threshold. However, a smaller p value does not imply that the observed result will be reproducible. In this study, we suggest interpreting SPMs in conjunction with reproducibility evidence. Reproducibility is defined as the extent to which the active status of a voxel remains the same across replicates conducted under the same conditions. We propose a methodology for assessing reproducibility in functional MR images without conducting separate experiments. Our procedures include the empirical Bayes method for estimating effects due to experimental stimuli, the threshold optimization procedure for assigning voxels to the active status, and the construction of reproducibility maps. In an empirical example, we implemented the proposed methodology to construct reproducibility maps based on data from the study by Ishai et al. (2000). The original experiments involved 12 human subjects and investigated brain regions most responsive to visual presentation of 3 categories of objects: faces, houses, and chairs. The brain regions identified included occipital, temporal, and fusiform gyri. Using our reproducibility analysis, we found that subjects in one of the experiments exercised at least 2 mechanisms in responding to visual objects when performing alternately matching and passive tasks. One gave activation maps closer to those reported in Ishai et al., and the other had related regions in the precuneus and posterior cingulate. The patterns of activated regions are reproducible for at least 4 out of 6 subjects involved in the experiment. Empirical application of the proposed methodology suggests that human brains exhibit different strategies to accomplish experimental tasks when responding to stimuli. It is important to correlate activations to subjects' behavior such as reaction time and response accuracy. Also, the latency between the stimulus presentation and the peak of the hemodynamic response function varies considerably among individual subjects according to types of stimuli and experimental tasks. These variations per se also deserve scientific inquiries. We conclude by discussing research directions relevant to reproducibility evidence in fMRI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Detecting activations in PET and fMRI: levels of inference and power
Friston, K. J., Holmes, A., Poline, J.-B., Price, C. J., & Frith, C. D. (1996) · NeuroImage · doi:10.1006/nimg.1996.0074 · Cited by 1,148 · cited 1×
“The ROC approach has been recommended for comparing statistical methods in fMRI data analyses (Maitra et al., 2002; Skudlarski et al., 1999; Genovese et al., 1997; Friston, Holmes, Poline, Price, & Frith, 1996).”
MethodNull hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Cited by
Analysis of a large fMRI cohort: statistical and methodological issues for group analyses
Thirion, B., Pinel, P., Mériaux, S., Roche, A., Dehaene, S., & Poline, J.-B. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.11.054 · Cited by 563
Test-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery.
Plichta, M. M., Schwarz, A. J., Grimm, O., Morgen, K., Mier, D., Haddad, L., Gerdes, A. B. M., Sauer, C., Tost, H., Esslinger, C., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.129 · Cited by 287
Sharing neuroimaging studies of human cognition
Horn, J. D. V., Grafton, S. T., Rockmore, D., & Gazzaniga, M. S. (2004) · Nature Neuroscience · doi:10.1038/nn1231 · Cited by 83
WSPM: Wavelet-based statistical parametric mapping
Van De Ville, D., Seghier, M. L., Lazeyras, F., Blu, T., & Unser, M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.011 · Cited by 46
“Several studies have recommended the ROC approach for validating and comparing statistical methods, e.g., Friston et al. (1996b), Genovese et al. (1997), Skudlarski et al. (1999), Maitra et al. (2002), Liou et al. (2003), Fadili and Bullmore (2004), and Liou et al. (2006).”
Method
Metadata
- Authors
- Liou, M., Su, H.-R., Lee, J.-D., Cheng, P. E., Huang, C.-C., & Tsai, C.-H.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press
- Published
- 2003-10-01
- Volume
- 15
- Issue
- 7
- Pages
- 935-945
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2133689199
- Cited by
- 35
- References
- 4
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bridging Functional MR Images and Scientific Inference: Reproducibility Maps. https://app.cochat.ai/papers/10.1162/089892903770007326
- The paper
- Liou, M., Su, H.-R., Lee, J.-D., Cheng, P. E., Huang, C.-C., & Tsai, C.-H. (2003). Bridging Functional MR Images and Scientific Inference: Reproducibility Maps. Journal of Cognitive Neuroscience. https://doi.org/10.1162/089892903770007326
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.