The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
CATD: Unified Representation Learning for EEG-to-fMRI Cross-Modal Generation
Open accessAbstract
Multi-modal neuroimaging analysis is crucial for a comprehensive understanding of brain function and pathology, as it allows for the integration of different imaging techniques, thus overcoming the limitations of individual modalities. However, the high costs and limited availability of certain modalities pose significant challenges. To address these issues, this paper proposes the Condition-Aligned Temporal Diffusion (CATD) framework for end-to-end cross-modal synthesis of neuroimaging, enabling the generation of functional magnetic resonance imaging (fMRI)-detected Blood Oxygen Level Dependent (BOLD) signals from more accessible Electroencephalography (EEG) signals. By constructing Conditionally Aligned Block (CAB), heterogeneous neuroimages are aligned into a latent space, achieving a unified representation that provides the foundation for cross-modal transformation in neuroimaging. The combination with the constructed Dynamic Time-Frequency Segmentation (DTFS) module also enables the use of EEG signals to improve the temporal resolution of BOLD signals, thus augmenting the capture of the dynamic details of the brain. Experimental validation demonstrates that the framework improves the accuracy of brain activity state prediction by 9.13% (reaching 69.8%), enhances the diagnostic accuracy of brain disorders by 4.10% (reaching 99.55%), effectively identifies abnormal brain regions, enhancing the temporal resolution of BOLD signals. The proposed framework establishes a new paradigm for cross-modal synthesis of neuroimaging by unifying heterogeneous neuroimaging data into a latent representation space, showing promise in medical applications such as improving Parkinson's disease prediction and identifying abnormal brain regions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As validated by a 9.13% increase in brain-state prediction accuracy (69.8%) and a 4.10% increase in diagnostic precision for brain disorders (99.55%)”
From Multimodal neuroimaging and AI integration in cognitive disorders: advances, challenges, and future directions for precision medicine (2026) · cites this paper as Yao et al., 2025
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328
Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature
Destrieux, C., Fischl, B., Dale, A., & Halgren, E. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.010 · Cited by 2,956 · cited 1×
“This region is the lingual gyrus, the medial occipito-temporal gyrus and the lateral occipito-temporal gyrus [52], which, in patients with Parkinson’s disease, shows significant structural changes [53], and in patients with PD accompanied by visual hallucinations, the atrophy of these three brain…”
Within-subject template estimation for unbiased longitudinal image analysis
Reuter, M., Schmansky, N. J., Rosas, H. D., & Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.084 · Cited by 2,356
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00387 · Cited by 2,284
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2022) · arXiv · doi:10.48550/arxiv.2212.09748 · Cited by 2,284
What does fMRI tell us about neuronal activity?
Heeger, D. J., & Ress, D. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn730 · Cited by 1,085
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision ModelsPreprint
Liu, Y., Zhang, K., Li, Y., Yan, Z., Gao, C., Chen, R., Yuan, Z., Huang, Y., Sun, H., Gao, J., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.17177 · Cited by 874
Bedside detection of awareness in the vegetative state: a cohort study
Cruse, D., Chennu, S., Chatelle, C., Bekinschtein, T. A., Fernández-Espejo, D., Pickard, J. D., Laureys, S., & Owen, A. M. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61224-5 · Cited by 712
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
High-resolution image reconstruction with latent diffusion models from human brain activity
Takagi, Y., & Nishimoto, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01389 · Cited by 297
Yen, C., Lin, C.-L., & Chiang, M.-C. (2023) · Life · doi:10.3390/life13071472 · Cited by 281
Changing concepts in presurgical assessment for epilepsy surgery
Zijlmans, M., Zweiphenning, W., & van Klink, N. (2019) · Nature Reviews Neurology · doi:10.1038/s41582-019-0224-y · Cited by 217
Functional ultrasound imaging of brain activity in human newborns
Demene, C., Baranger, J., Bernal, M., Delanoe, C., Auvin, S., Biran, V., Alison, M., Mairesse, J., Harribaud, E., Pernot, M., et al. (2017) · Science Translational Medicine · doi:10.1126/scitranslmed.aah6756 · Cited by 207
Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis
Hu, S., Lei, B., Wang, S., Wang, Y., Feng, Z., & Shen, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3107013 · Cited by 176
Self-citationBraun, U., Harneit, A., Pergola, G., Menara, T., Schäfer, A., Betzel, R. F., Zang, Z., Schweiger, J. I., Zhang, X., Schwarz, K., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-23694-9 · Cited by 174
Electrical fingerprint of the amygdala guides neurofeedback training for stress resilience
Keynan, J. N., Cohen, A., Jackont, G., Green, N., Goldway, N., Davidov, A., Meir-Hasson, Y., Raz, G., Intrator, N., Fruchter, E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0484-3 · Cited by 166
Anwar, A. R., Muthalib, M., Perrey, S., Galka, A., Granert, O., Wolff, S., Heute, U., Deuschl, G., Raethjen, J., & Muthuraman, M. (2016) · Brain Topography · doi:10.1007/s10548-016-0507-1 · Cited by 157
Estimating the Delay of the fMRI Response
Liao, C. H., Worsley, K. J., Poline, J.-B., Aston, J. A. D., Duncan, G. H., & Evans, A. C. (2002) · NeuroImage · doi:10.1006/nimg.2002.1096 · Cited by 155
Relating resting-state fMRI and EEG whole-brain connectomes across frequency bands
Deligianni, F., Centeno, M., Carmichael, D. W., & Clayden, J. D. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00258 · Cited by 148
Accelerated functional brain aging in pre-clinical familial Alzheimer’s disease
Gonneaud, J., Baria, A. T., Binette, A. P., Gordon, B. A., Chhatwal, J. P., Cruchaga, C., Jucker, M., Levin, J., Salloway, S., Farlow, M. R., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-25492-9 · Cited by 116
Neural interfaces: Bridging the brain to the world beyond healthcare
Xu, S., Liu, Y., Lee, H., & Li, W. (2024) · Exploration · doi:10.1002/exp.20230146 · Cited by 116
Wavelet-Improved Score-Based Generative Model for Medical Imaging
Wu, W., Wang, Y., Liu, Q., Wang, G., & Zhang, J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3325824 · Cited by 105
Kronemer, S. I., Aksen, M., Ding, J. Z., Ryu, J. H., Xin, Q., Ding, Z., Prince, J. S., Kwon, H., Khalaf, A. F., Forman, S., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-35117-4 · Cited by 101
Zong, Y., Zuo, Q., Ng, M. K., Lei, B., & Wang, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3442811 · Cited by 100
Self-citationNODDI and Tensor-Based Microstructural Indices as Predictors of Functional Connectivity
Deligianni, F., Carmichael, D. W., Zhang, H. G., Clark, C. A., & Clayden, J. D. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153404 · Cited by 81
Huang, Y., Wei, P., Xu, L., Chen, D., Yang, Y., Song, W., Yi, Y., Jia, X., Wu, G., Fan, Q., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-39067-3 · Cited by 80
Federated Domain Adaptation via Transformer for Multi-Site Alzheimer’s Disease Diagnosis
Lei, B., Zhu, Y., Liang, E., Yang, P., Chen, S., Hu, H., Xie, H., Wei, Z., Hao, F., Song, X., et al. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3300725 · Cited by 80
Self-citationLioi, G., Cury, C., Perronnet, L., Mano, M., Bannier, É., Lécuyer, A., & Barillot, C. (2020) · Scientific Data · doi:10.1038/s41597-020-0498-3 · Cited by 73
St-Yves, G., Allen, E., Wu, Y., Kay, K., & Naselaris, T. (2023) · Nature Communications · doi:10.1038/s41467-023-38674-4 · Cited by 72
Parkinson disease psychosis: from phenomenology to neurobiological mechanisms
Pagonabarraga, J., Bejr-Kasem, H., Martinez-Horta, S., & Kulisevsky, J. (2024) · Nature Reviews Neurology · doi:10.1038/s41582-023-00918-8 · Cited by 69
Talishinsky, A., Downar, J. H., Vértes, P. E., Seidlitz, J., Dunlop, K., Lynch, C. J., Whalley, H. C., McIntosh, A. M., Vila‐Rodriguez, F., Daskalakis, Z. J., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32617-1 · Cited by 63
Narsude, M., Gallichan, D., van der Zwaag, W., Rolf Gruetter, A., & Marques, J. P. (2015) · Magnetic Resonance in Medicine · doi:10.1002/mrm.25835 · Cited by 61
IRC-GAN: Introspective Recurrent Convolutional GAN for Text-to-video Generation
Deng, K., Fei, T., Huang, X., & Peng, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/307 · Cited by 51
Vignando, M., ffytche, D., Lewis, S. J. G., Lee, P. H., Chung, S. J., Weil, R. S., Hu, M. T., Mackay, C. E., Griffanti, L., Pins, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28087-0 · Cited by 42 · cited 1×
“…gyrus and the lateral occipito-temporal gyrus [52], which, in patients with Parkinson’s disease, shows significant structural changes [53], and in patients with PD accompanied by visual hallucinations, the atrophy of these three brain regions correlates with the severity of visual…”
Raimondo, L., Knapen, T. H. J., de Oliveira, I. A. F., Yu, X., Dumoulin, S. O., van der Zwaag, W., & Siero, J. C. W. (2021) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x211037266 · Cited by 37
Reconstructing lost BOLD signal in individual participants using deep machine learning
Yan, Y., Dahmani, L., Ren, J., Shen, L., Peng, X., Wang, R., He, C., Jiang, C., Gong, C., Tian, Y., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18823-9 · Cited by 35
Xie, Y., Wan, Q., Xie, H., Xu, Y., Wang, T., Wang, S., & Lei, B. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3263216 · Cited by 31
Self-citationMotor imagery EEG signal classification with a multivariate time series approach
Velasco, I., Sipols, A. E., de Blas, C. S., Pastor, L., & Bayona, S. (2023) · BioMedical Engineering OnLine · doi:10.1186/s12938-023-01079-x · Cited by 29
Immersive Agricultural Education: Gamifying Learning With Augmented Reality and Virtual Reality
Bigonah, M., Jamshidi, F., & Marghitu, D. (2024) · Advances in early childhood and K-12 education · doi:10.4018/979-8-3693-1710-5.ch002 · Cited by 29
LR-Net: A Block-based Convolutional Neural Network for Low-Resolution Image Classification
Ganj, A., Ebadpour, M., Darvish, M., & Bahador, H. J. (2023) · Iranian Journal of Science and Technology Transactions of Electrical Engineering · doi:10.1007/s40998-023-00618-5 · Cited by 27
Zoubi, O. A., Mayeli, A., Misaki, M., Tsuchiyagaito, A., Zotev, V. S., Refai, H. H., Paulus, M. P., & Bodurka, J. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac4595 · Cited by 26
3-D Brain Reconstruction by Hierarchical Shape-Perception Network From a Single Incomplete Image
Hu, B., Lei, B.-Y., Wang, S., Liu, Y., Wang, B.-C., Gan, M., & Shen, Y.-Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266819 · Cited by 24
Self-citationDeep-learning-enabled brain hemodynamic mapping using resting-state fMRI
Hou, X., Guo, P., Wang, P., Liu, P., Lin, D. D. M., Fan, H., Li, Y., Wei, Z., Lin, Z., Jiang, D., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00859-y · Cited by 21
Mehrnia, M., Kholmovski, E. G., Katsaggelos, A. K., Kim, D. J., PASSMAN, R. S., & Elbaz, M. S. M. (2024) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2024.3476930 · Cited by 18
Petrov, A. Y., Herbst, M., & Stenger, V. A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.004 · Cited by 17
Lyu, J., Chen, X., AlQahtani, S. A., & Hossain, M. S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102342 · Cited by 16
EEG To FMRI Synthesis: Is Deep Learning a Candidate?
Calhas, D., & Henriques, R. (2023) · Proceedings of the International Conference on Information Systems Development · doi:10.62036/isd.2023.26 · Cited by 15
Casagrande, C. C., Rempe, M. P., Springer, S. D., & Wilson, T. W. (2023) · Ageing Research Reviews · doi:10.1016/j.arr.2023.101950 · Cited by 14
Fang, T., Wang, J., Mu, W., Song, Z., Zhang, X., Zhan, G., Wang, P., Bin, J., Niu, L., Zhang, L., et al. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca82d · Cited by 13
Brain imaging: fMRI advances make scans sharper and faster
Kwon, D. (2023) · Nature · doi:10.1038/d41586-023-01616-7 · Cited by 13
An Electroencephalography Profile of Paroxysmal Kinesigenic Dyskinesia
Luo, H., Huang, X., Li, Z., Tian, W., Fang, K., Liu, T., Wang, S., Tang, B., Hu, J., Yuan, T., et al. (2024) · Advanced Science · doi:10.1002/advs.202306321 · Cited by 12
Self-citationEEGg: Generating Synthetic EEG Signals in Matlab Environment
Vaziri, A. Y., Makkiabadi, B., & Samadzadehaghdam, N. (2023) · Frontiers in biomedical technologies · doi:10.18502/fbt.v10i3.13165 · Cited by 11
Early recognition of parkinson's disease through acoustic analysis and machine learning
Fadavi, N., & Fadavi, N. (2024) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2024.23.2.2271 · Cited by 10
You, S., Yuan, B., Lv, Z., Chui, C. K., Chen, C. L. P., Lei, B., & Wang, S. (2024) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2024.3434724 · Cited by 6
Self-citationIn Pursuit of Delay-Related Brain Activity for Anticipatory Eye Movements
Burke, M. R., & Barnes, G. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073326 · Cited by 3
EEG to fMRI Synthesis: Is Deep Learning a candidate?Preprint
Calhas, D., & Henriques, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14133 · Cited by 1
Early Recognition of Parkinson's Disease Through Acoustic Analysis and Machine LearningPreprint
Fadavi, N., & Fadavi, N. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.16091
Research works printed but not linked: 2
- von Platen, 2022, Diffusers: State-of-the-art diffusion models
- Cavanagh, 2021, EEG: 3-Stim auditory oddball and rest in Parkinson’s
Cited by
Li, Z., Yu, Y., Zeng, N., Tian, F., Zhang, S., Sun, H., & Li, Q. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106566 · Cited by 23
Dang, M., Liu, B., Chen, Y., & Zhang, Z. (2026) · Psychoradiology · doi:10.1093/psyrad/kkag007 · Cited by 10
Zuo, Q., Lei, B., Qiu, W., Jing, C., Hong, J., & Wang, S. (2026) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2026.3677325 · Cited by 9
“Recent works [39], [40] of cross-modal imaging data generation have designed the DDPM-related model to achieve good results.”
Self-citationWang, S., Guo, Y., Dong, Y., Shen, Y., Zhang, Z., Cheung, A. C., Pu, J., Zhong, S.-H., Tong, R. K., Li, Y., et al. (2026) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3650654 · Cited by 6
“More recent work has proposed pre-trained generative frameworks that construct unified latent representations across EEG, fMRI, and fNIRS, enabling arbitrary translation among modalities while preserving activation patterns and oscillatory features [41], [43].”
Self-citationSingh, L., Kumar, A., & Golash, R. (2026) · The European Physical Journal Plus · doi:10.1140/epjp/s13360-026-07296-2 · Cited by 3
“Accuracy and recognition rate (RR): Accuracy remains a staple metric for classification tasks, reported by numerous studies including Abdullahi et al. [77], Zhang et al. [88], Joshi et al. [73], and Ghani et al. [69].”
Influential
Metadata
- Authors
- Yao, W., Lyu, Z., Mahmud, M., Zhong, N., Lei, B., & Wang, S.
- Affiliations
- Chinese Academy of Sciences (CN)
- Department of Game Design, Faculty of Arts, Uppsala University, Uppsala, Sweden
- King Fahd University of Petroleum and Minerals (SA)
- Maebashi Institute of Technology (JP)
- Shenzhen University (CN)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2025-07
- Volume
- 44
- Issue
- 7
- Pages
- 2757-2767
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W4408324194
- Cited by
- 24
- References
- 56
- Citations by year
- 2026: 18 · 2025: 6
- FWCI
- 13.76
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundations of China (62172403, 12326614)
- Distinguished Young Scholars Fund of Guangdong (2021B1515020019)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- temporal diffusion, brain disorder diagnosis, Parkinson's disease prediction, temporal resolution enhancement
- MeSH terms
- Adult, Algorithms, Brain, Electroencephalography, Female, Humans, Magnetic Resonance Imaging, Male, Signal Processing, Computer-Assisted, Multimodal Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.